Sep 28 16:55:04 devstack cinder-volume[75784]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:55:04 devstack cinder-volume[75784]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:55:04 devstack cinder-volume[75784]: we strongly recommend against using it for new projects. Sep 28 16:55:04 devstack cinder-volume[75784]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:55:04 devstack cinder-volume[75784]: framework. For more detail see Sep 28 16:55:04 devstack cinder-volume[75784]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:55:04 devstack cinder-volume[75784]: import eventlet # noqa Sep 28 16:55:07 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:55:07 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:55:07 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:55:07 devstack cinder-volume[75784]: INFO dbcounter [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Registered counter for database cinder Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG oslo_db.sqlalchemy.engines [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writer thread running {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:55:08 devstack cinder-volume[75784]: INFO cinder.rpc [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:55:08 devstack cinder-volume[75784]: INFO cinder.rpc [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG oslo_db.sqlalchemy.engines [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:08 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Determined volume DB was empty at startup. Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG cinder.volume.manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75784) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:55:08 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:55:08 devstack cinder-volume[75784]: WARNING stevedore.named [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:55:08 devstack cinder-volume[75784]: WARNING castellan.key_manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:08 devstack cinder-volume[75784]: WARNING cinder.keymgr.conf_key_mgr [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG cinder.volume.drivers.lvm [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75784) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 16:55:08 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_concurrency.processutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=75784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_db.sqlalchemy.engines [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:09 devstack cinder-volume[75784]: INFO cinder.rpc [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 16:55:09 devstack cinder-volume[75784]: INFO cinder.rpc [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 16:55:09 devstack cinder-volume[75784]: WARNING stevedore.named [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:55:09 devstack cinder-volume[75784]: WARNING castellan.key_manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:09 devstack cinder-volume[75784]: INFO cinder.volume.manager [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_db.sqlalchemy.engines [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:09 devstack cinder-volume[75784]: INFO oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Starting 1 workers Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Started child 75933 {{(pid=75784) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Full set of CONF: {{(pid=75784) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] ******************************************************************************** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Configuration options gathered from: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] ================================================================================ {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] allow_availability_zone_fallback = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] allow_compression_on_image_upload = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] allowed_direct_url_schemes = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] api_rate_limit = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] auth_strategy = keystone {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] az_cache_duration = 3600 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_availability_zone = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_host = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_stats_polling_interval = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backup_api_class = cinder.backup.api.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backup_name_template = backup-%s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backup_use_same_host = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backup_use_temp_snapshot = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] chap_password = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75933]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] chap_username = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_internal_tenant_project_id = 6abe40316b21413eb8bf1207ed414b67 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_internal_tenant_user_id = d4243e162c6e4cdeac001e921bfb5313 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cloned_volume_same_az = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cluster = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] compression_format = gzip {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] compute_api_class = cinder.compute.nova.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] config_dir = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] config_source = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] control_exchange = openstack {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] debug = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] default_availability_zone = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] default_group_type = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] default_volume_type = lvmdriver-1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] disk_geometry = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_client_cert = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_client_cert_key = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_data_namespace = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_ssl_cert_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_ssl_cert_verify = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] driver_use_ssl = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] enable_force_upload = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] enable_new_services = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] enable_unsupported_driver = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] enforce_multipath_for_image_xfer = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] filter_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_api_insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_api_ssl_compression = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_ca_certificates_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_catalog_info = image:glance:publicURL {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_num_retries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance_request_timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] goodness_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] graceful_shutdown_timeout = 5 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] group_api_class = cinder.group.api.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] host = devstack {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_compress_on_upload = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_conversion_address_space_limit = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_conversion_cpu_limit = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_conversion_disable = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_introspection_address_space_limit = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_introspection_cpu_limit = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_upload_use_cinder_backend = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_upload_use_internal_tenant = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_volume_cache_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_volume_cache_max_count = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] image_volume_cache_max_size_gb = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] init_host_max_objects_retrieval = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] instance_format = [instance: %(uuid)s] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iscsi_target_flags = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iscsi_write_cache = on {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iser_helper = tgtadm {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iser_ip_address = 192.168.122.64 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iser_port = 3260 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_color = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_config_append = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_dir = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_options = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_rotate_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_rotate_interval_type = days {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] log_rotation_type = none {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] max_age = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] max_logfile_count = 30 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] max_logfile_size_mb = 200 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] max_over_subscription_ratio = 20.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] message_reap_interval = 86400 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] message_ttl = 2592000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] migration_create_volume_timeout_secs = 300 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] monkey_patch = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] monkey_patch_modules = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] my_ip = 192.168.122.64 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] no_snapshot_gb_quota = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] num_iser_scan_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] num_shell_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] num_volume_device_scan_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] nvmeof_conn_info_version = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] nvmet_ns_id = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] nvmet_port_id = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_max_limit = 1000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_ext_list = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_listen_port = 8776 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_use_ssl = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] osapi_volume_workers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] per_volume_size_limit = -1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] periodic_fuzzy_delay = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] periodic_interval = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] public_endpoint = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] publish_errors = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_backup_gigabytes = 1000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_backups = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_gigabytes = 1000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_groups = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_snapshots = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] quota_volumes = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] rate_limit_burst = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] rate_limit_except_level = CRITICAL {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] rate_limit_interval = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] reinit_driver_count = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] replication_device = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] report_discard_supported = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] report_interval = 120 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] reservation_clean_interval = 86400 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] reservation_expire = 86400 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] reserved_image_namespaces = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] reserved_percentage = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] rpc_response_timeout = 120 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] run_external_periodic_tasks = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] scst_target_driver = iscsi {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] scst_target_iqn_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_down_time = 720 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] shell_completion = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] snapshot_name_template = snapshot-%s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] snapshot_same_host = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] split_loggers = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] state_path = /opt/stack/data/cinder {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] storage_availability_zone = nova {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] storage_protocol = iSCSI {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] syslog_log_facility = LOG_USER {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_helper = lioadm {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_ip_address = 192.168.122.64 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_port = 3260 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_protocol = iscsi {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] target_secondary_ip_addresses = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] trace_flags = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] transport_url = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] until_refresh = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_chap_auth = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_default_quota_class = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_journal = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_json = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_multipath_for_image_xfer = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_stderr = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] use_syslog = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] verify_glance_signatures = enabled {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_api_class = cinder.volume.api.API {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_backend_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_clear = zero {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_clear_ionice = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_clear_size = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_copy_bps_limit = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_dd_blocksize = 1M {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_name_template = volume-%s {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_service_inithost_offload = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volume_usage_audit_period = month {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] zoning_mode = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_concurrency.disable_process_locking = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: INFO cinder.volume.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.auth_section = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.auth_type = password {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.auth_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.cache = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.include_service_catalog = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.interface = public {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_password = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcache_username = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.region_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.service_type = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.backend = dogpile.cache.null {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.backend_argument = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.backend_expiration_time = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.config_prefix = cache.oslo {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.debug_cache_backend = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.enable_retry_client = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.enable_socket_keepalive = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.expiration_time = 600 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.hashclient_retry_attempts = 2 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_dead_retry = 300 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_pool_maxsize = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_sasl_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.password = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.proxies = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.redis_db = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.redis_server = localhost:6379 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.retry_attempts = 2 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.retry_delay = 0.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.socket_keepalive_count = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.socket_keepalive_idle = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.socket_keepalive_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.socket_timeout = 1.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.tls_allowed_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.tls_cafile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.tls_certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.tls_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.tls_keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cache.username = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] coordination.backend_url = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.asyncio_connection = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.asyncio_slave_connection = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.backend = sqlalchemy {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.connection = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.connection_debug = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.connection_parameters = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.connection_recycle_time = 3600 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.connection_trace = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.db_inc_retry_interval = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.db_max_retries = 20 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.db_max_retry_interval = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.db_retry_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.max_overflow = 50 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.max_pool_size = 5 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.max_retries = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.mysql_wsrep_sync_wait = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.pool_timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.retry_interval = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.slave_connection = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.sqlite_synchronous = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.synchronous_reader = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] database.use_db_reconnect = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_tracing.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.connection_string = messaging:// {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.es_doc_type = notification {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.es_scroll_size = 10000 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.es_scroll_time = 2m {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.filter_error_trace = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.hmac_keys = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.sentinel_service_name = mymaster {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.socket_timeout = 0.1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.trace_requests = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler.trace_sqlalchemy = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler_jaeger.process_tags = {} {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler_jaeger.service_name_prefix = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] profiler_otlp.service_name_prefix = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.enforce_new_defaults = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.policy_default_rule = default {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.policy_file = policy.yaml {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.group = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.helper_command = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] privsep_osbrick.user = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.group = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.helper_command = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] cinder_sys_admin.user = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.auth_section = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.auth_type = password {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.cafile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.collect_timing = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.send_service_user_token = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.split_loggers = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.tls_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] service_user.tls_min_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.auth_section = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.auth_type = password {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.collect_timing = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.region_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.split_loggers = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.tls_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] glance.tls_min_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.backend_availability_zone = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.chap_password = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.chap_username = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.disk_geometry = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_client_cert = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_client_cert_key = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_data_namespace = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.driver_use_ssl = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.extra_capabilities = {} {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.filter_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.goodness_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iscsi_target_flags = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iscsi_write_cache = on {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iser_helper = tgtadm {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iser_port = 3260 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.lvm_share_target = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.lvm_type = auto {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.num_shell_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.replication_device = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.report_discard_supported = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.reserved_percentage = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_helper = tgtadm {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_port = 3260 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_protocol = iscsi {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.trace_flags = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.unique_fqdn_network = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.use_chap_auth = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_backend_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_clear = zero {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_clear_ionice = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_clear_size = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_reports.file_event_handler = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_reports.log_dir = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.backend_host = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.chap_password = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack sudo[75938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.chap_username = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.disk_geometry = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_client_cert = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack sudo[75938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.extra_capabilities = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.filter_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.goodness_function = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iser_helper = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iser_ip_address = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iser_port = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.lvm_share_target = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.lvm_type = auto {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.num_shell_tries = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.replication_device = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.report_discard_supported = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.reserved_percentage = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.scst_target_driver = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.storage_protocol = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_helper = lioadm {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_ip_address = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_port = 3260 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.trace_flags = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.use_chap_auth = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_clear = zero {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_clear_size = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] lvmdriver-1.volumes_dir = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_notifications.driver = [] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_notifications.retry = -1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] key_manager.fixed_key = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.barbican_api_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.barbican_endpoint = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.barbican_endpoint_type = public {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.barbican_region_name = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.cafile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.collect_timing = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.number_of_retries = 60 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.retry_delay = 1 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.send_service_user_token = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.split_loggers = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.tls_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.tls_min_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.verify_ssl = True {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican.verify_ssl_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.auth_section = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.auth_type = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.cafile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.certfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.collect_timing = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.insecure = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.keyfile = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.split_loggers = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.timeout = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.tls_ciphers = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] barbican_service_user.tls_min_version = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.approle_role_id = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.approle_secret_id = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.auth_method = approle {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.auth_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.kv_mountpoint = secret {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.kv_path = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.kv_version = 2 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.namespace = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.root_token_id = **** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.ssl_ca_crt_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.timeout = 60.0 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.token_file = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.token_role = None {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.use_ssl = False {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:09 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] ******************************************************************************** {{(pid=75784) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:55:09 devstack sudo[75938]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:09 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:09 devstack sudo[75942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:09 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:10 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.302s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:55:10 devstack cinder-volume[75933]: INFO cinder.brick.local_dev.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:10 devstack sudo[75950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:10 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:10 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG cinder.brick.local_dev.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75933) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 16:55:10 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:10 devstack sudo[76120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:10 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:11 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.592s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:11 devstack sudo[76411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:11 devstack sudo[76411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:11 devstack sudo[76411]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:11 devstack sudo[76514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 16:55:11 devstack sudo[76514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:11 devstack sudo[76514]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.344s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:11 devstack sudo[76635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:11 devstack sudo[76635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:12 devstack sudo[76635]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:12 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:12 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:12 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:12 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:12 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:12 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:12 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:12 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:13 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.408s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:13 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:13 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:13 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:13 devstack cinder-volume[75933]: INFO cinder.volume.drivers.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:13 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:13 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:13 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:13 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:13 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:14 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:14 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:14 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:14 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:14 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:14 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:14 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:14 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:14 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:14 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:15 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:15 devstack cinder-volume[75933]: INFO cinder.volume.driver [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG cinder.volume.driver [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75933) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_db.sqlalchemy.engines [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75933) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writer thread running {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG cinder.db.api [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Building query based on filter {{(pid=75933) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG cinder.image.image_utils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75933) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:55:15 devstack cinder-volume[75933]: INFO cinder.keymgr.migration [None req-9beb286d-f2fe-4c57-aa6c-12ab29d2b1fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:15 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:15 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:15 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:15 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:15 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:15 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:15 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:15 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:15 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:16 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:16 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:16 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:16 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG cinder.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Notifying Schedulers of capabilities ... {{(pid=75933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:55:16 devstack cinder-volume[75933]: INFO cinder.volume.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Driver initialization completed successfully. Sep 28 16:55:16 devstack cinder-volume[75933]: INFO cinder.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Initiating service 2 cleanup Sep 28 16:55:16 devstack cinder-volume[75933]: INFO cinder.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Service 2 cleanup completed. Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG cinder.service [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Creating RPC server for service cinder-volume {{(pid=75933) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG cinder.service [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75933) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:55:16 devstack cinder-volume[75933]: INFO cinder.volume.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:16 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:16 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:16 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:16 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:16 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:16 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:17 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:17 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:17 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:17 devstack sudo[76867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:17 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:17 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:17 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:17 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:17 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:17 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:17 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:17 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:17 devstack cinder-volume[75933]: INFO cinder.volume.manager [None req-28f0e2fa-7ff7-4e67-b4e3-957ab8e8b9d4 None None] Driver post RPC initialization completed successfully. Sep 28 16:55:19 devstack cinder-volume[75784]: DEBUG dbcounter [-] [75784] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:26 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:27 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:56:11 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:56:11 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:56:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:11 devstack sudo[78759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:56:11 devstack sudo[78759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:12 devstack sudo[78759]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:12 devstack sudo[78766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:56:12 devstack sudo[78766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:12 devstack sudo[78766]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:12 devstack sudo[78769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:56:12 devstack sudo[78769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:12 devstack sudo[78769]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:56:12 devstack sudo[78772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:56:12 devstack sudo[78772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:56:12 devstack sudo[78772]: pam_unix(sudo:session): session closed for user root Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG cinder.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Notifying Schedulers of capabilities ... {{(pid=75933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread count: 6 {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:56:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread info: [<_MainThread(MainThread, started 137745794789504)>, , , , , ] {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:57:11 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:57:11 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:57:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:11 devstack sudo[82031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:11 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:12 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:12 devstack sudo[82034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:12 devstack sudo[82034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:12 devstack sudo[82034]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:12 devstack sudo[82038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:12 devstack sudo[82038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:12 devstack sudo[82038]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:12 devstack sudo[82042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:12 devstack sudo[82042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:12 devstack sudo[82042]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG cinder.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Notifying Schedulers of capabilities ... {{(pid=75933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread count: 6 {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:57:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread info: [<_MainThread(MainThread, started 137745794789504)>, , , , , ] {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:57:27 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writing DB stats cinder:SELECT=1 {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:57:27 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writing DB stats cinder:UPDATE=1 {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:58:11 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:11 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:58:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:11 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:58:11 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:12 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:12 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:12 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:12 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:12 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:58:12 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:12 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:12 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:12 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:12 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG cinder.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Notifying Schedulers of capabilities ... {{(pid=75933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread count: 6 {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:58:12 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread info: [<_MainThread(MainThread, started 137745794789504)>, , , , , ] {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:11 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:11 devstack cinder-volume[75933]: DEBUG cinder.volume.drivers.lvm [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Updating volume stats {{(pid=75933) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:11 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:11 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:11 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:12 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:12 devstack sudo[85136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:12 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:12 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:12 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:12 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:12 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:12 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:12 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:12 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:13 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:13 devstack cinder-volume[75933]: DEBUG oslo_concurrency.processutils [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75933) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:13 devstack cinder-volume[75933]: DEBUG cinder.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Notifying Schedulers of capabilities ... {{(pid=75933) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:13 devstack cinder-volume[75933]: DEBUG oslo_service.periodic_task [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75933) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:13 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread count: 6 {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:59:13 devstack cinder-volume[75933]: DEBUG cinder.volume.manager [None req-3f6b6022-4c56-4a60-9566-2818f48728e4 None None] thread info: [<_MainThread(MainThread, started 137745794789504)>, , , , , ] {{(pid=75933) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:27 devstack cinder-volume[75933]: DEBUG dbcounter [-] [75933] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75933) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:54 devstack cinder-volume[75784]: INFO oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Caught SIGTERM, stopping children Sep 28 16:59:54 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Acquiring lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:54 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Acquired lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:54 devstack cinder-volume[75784]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Releasing lock "singleton_lock" {{(pid=75784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:54 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Stop services. {{(pid=75784) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 16:59:54 devstack cinder-volume[75784]: DEBUG oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Killing children. {{(pid=75784) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 16:59:54 devstack cinder-volume[75784]: INFO oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Waiting on 1 children to exit Sep 28 16:59:56 devstack cinder-volume[75933]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Acquiring lock "singleton_lock" {{(pid=75933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:56 devstack cinder-volume[75933]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Acquired lock "singleton_lock" {{(pid=75933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:56 devstack cinder-volume[75933]: DEBUG oslo_concurrency.lockutils [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Releasing lock "singleton_lock" {{(pid=75933) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:56 devstack cinder-volume[75933]: WARNING amqp [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:56 devstack cinder-volume[75933]: WARNING amqp [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:59:56 devstack cinder-volume[75784]: INFO oslo_service.backend._eventlet.service [None req-97656344-c5ea-4b64-acd9-898c41d89656 None None] Child 75933 exited with status 0 Sep 28 16:59:57 devstack cinder-volume[86054]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:59:57 devstack cinder-volume[86054]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:59:57 devstack cinder-volume[86054]: we strongly recommend against using it for new projects. Sep 28 16:59:57 devstack cinder-volume[86054]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:59:57 devstack cinder-volume[86054]: framework. For more detail see Sep 28 16:59:57 devstack cinder-volume[86054]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:59:57 devstack cinder-volume[86054]: import eventlet # noqa Sep 28 16:59:59 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:59 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:59 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:59 devstack cinder-volume[86054]: INFO dbcounter [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Registered counter for database cinder Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_db.sqlalchemy.engines [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG dbcounter [-] [86054] Writer thread running {{(pid=86054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:00 devstack cinder-volume[86054]: INFO cinder.rpc [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:00 devstack cinder-volume[86054]: INFO cinder.rpc [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_db.sqlalchemy.engines [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86054]: INFO cinder.volume.manager [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Determined volume DB was empty at startup. Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG cinder.volume.manager [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86054) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:00 devstack cinder-volume[86054]: INFO cinder.volume.manager [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:00:00 devstack cinder-volume[86054]: WARNING stevedore.named [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:00 devstack cinder-volume[86054]: WARNING castellan.key_manager [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:00 devstack cinder-volume[86054]: WARNING cinder.keymgr.conf_key_mgr [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:00 devstack cinder-volume[86054]: INFO cinder.volume.manager [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_db.sqlalchemy.engines [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:00 devstack cinder-volume[86054]: INFO oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Starting 1 workers Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Started child 86252 {{(pid=86054) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Full set of CONF: {{(pid=86054) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] ******************************************************************************** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Configuration options gathered from: {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] ================================================================================ {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] allow_availability_zone_fallback = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] allow_compression_on_image_upload = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] allowed_direct_url_schemes = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] api_rate_limit = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] auth_strategy = keystone {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86252]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_availability_zone = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_host = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_stats_polling_interval = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backup_api_class = cinder.backup.api.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backup_name_template = backup-%s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backup_use_same_host = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backup_use_temp_snapshot = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] chap_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] chap_username = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_internal_tenant_project_id = 6abe40316b21413eb8bf1207ed414b67 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_internal_tenant_user_id = d4243e162c6e4cdeac001e921bfb5313 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cluster = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] compression_format = gzip {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] compute_api_class = cinder.compute.nova.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] config_dir = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] config_source = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] control_exchange = openstack {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] debug = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] default_availability_zone = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] default_group_type = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] default_volume_type = QuobyteHD {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] disk_geometry = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_client_cert = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_client_cert_key = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_data_namespace = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_ssl_cert_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_ssl_cert_verify = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] driver_use_ssl = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] enable_new_services = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] enable_unsupported_driver = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] enabled_backends = ['QuobyteHD'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] enforce_multipath_for_image_xfer = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] filter_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_api_insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_api_ssl_compression = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_ca_certificates_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_catalog_info = image:glance:publicURL {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_num_retries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance_request_timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] goodness_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] graceful_shutdown_timeout = 5 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] group_api_class = cinder.group.api.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] host = devstack {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_compress_on_upload = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_conversion_address_space_limit = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_conversion_cpu_limit = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_conversion_disable = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_introspection_address_space_limit = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_introspection_cpu_limit = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_upload_use_cinder_backend = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_upload_use_internal_tenant = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_volume_cache_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_volume_cache_max_count = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] image_volume_cache_max_size_gb = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] init_host_max_objects_retrieval = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] instance_format = [instance: %(uuid)s] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iscsi_target_flags = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iscsi_write_cache = on {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iser_helper = tgtadm {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iser_ip_address = 192.168.122.64 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iser_port = 3260 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_color = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_config_append = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:00 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_dir = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_options = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_rotate_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_rotate_interval_type = days {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] log_rotation_type = none {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] max_age = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] max_logfile_count = 30 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] max_logfile_size_mb = 200 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] max_over_subscription_ratio = 20.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] message_reap_interval = 86400 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] message_ttl = 2592000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] migration_create_volume_timeout_secs = 300 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] monkey_patch = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] monkey_patch_modules = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86252]: INFO cinder.volume.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.remotefs [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86252) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] my_ip = 192.168.122.64 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] no_snapshot_gb_quota = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] num_iser_scan_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] num_shell_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] num_volume_device_scan_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] nvmeof_conn_info_version = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] nvmet_ns_id = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] nvmet_port_id = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_max_limit = 1000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_ext_list = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_listen = 0.0.0.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_listen_port = 8776 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_use_ssl = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] osapi_volume_workers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] per_volume_size_limit = -1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] periodic_fuzzy_delay = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] periodic_interval = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] project_id_regex = [0-9a-f\-]+ {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] public_endpoint = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] publish_errors = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_backup_gigabytes = 1000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_backups = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_gigabytes = 1000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_groups = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_snapshots = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] quota_volumes = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] rate_limit_burst = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] rate_limit_except_level = CRITICAL {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] rate_limit_interval = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] reinit_driver_count = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] replication_device = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] report_discard_supported = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] report_interval = 120 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] reservation_clean_interval = 86400 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] reservation_expire = 86400 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] reserved_image_namespaces = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] reserved_percentage = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] rpc_response_timeout = 120 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] run_external_periodic_tasks = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] scst_target_driver = iscsi {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] scst_target_iqn_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_down_time = 720 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] shell_completion = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] snapshot_name_template = snapshot-%s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] split_loggers = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] state_path = /opt/stack/data/cinder {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] storage_availability_zone = nova {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] storage_protocol = iSCSI {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] syslog_log_facility = LOG_USER {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_helper = lioadm {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_ip_address = 192.168.122.64 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_port = 3260 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_protocol = iscsi {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] target_secondary_ip_addresses = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] trace_flags = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] transfer_api_class = cinder.transfer.api.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] transport_url = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] until_refresh = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_chap_auth = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_default_quota_class = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_journal = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_json = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_multipath_for_image_xfer = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_stderr = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] use_syslog = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] verify_glance_signatures = enabled {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_api_class = cinder.volume.api.API {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_backend_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_clear = zero {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_clear_ionice = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_clear_size = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_copy_bps_limit = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_dd_blocksize = 1M {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_name_template = volume-%s {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_service_inithost_offload = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volume_usage_audit_period = month {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] zoning_mode = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_concurrency.disable_process_locking = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.auth_section = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.auth_type = password {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.auth_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.cache = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.delay_auth_decision = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.http_connect_timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.include_service_catalog = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.interface = public {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcache_username = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.region_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.service_token_roles_required = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.service_type = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.token_cache_time = 300 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.backend = dogpile.cache.null {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.backend_argument = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.backend_expiration_time = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.config_prefix = cache.oslo {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.debug_cache_backend = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.enable_retry_client = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.enable_socket_keepalive = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.expiration_time = 600 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.hashclient_retry_attempts = 2 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_dead_retry = 300 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_pool_maxsize = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_sasl_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.proxies = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.redis_db = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.redis_sentinel_service_name = mymaster {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.redis_server = localhost:6379 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.retry_attempts = 2 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.retry_delay = 0.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.socket_keepalive_count = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.socket_keepalive_idle = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.socket_keepalive_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.socket_timeout = 1.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.tls_allowed_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.tls_cafile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.tls_certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.tls_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.tls_keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cache.username = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] coordination.backend_url = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.asyncio_connection = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.asyncio_slave_connection = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.backend = sqlalchemy {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.connection = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.connection_debug = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.connection_parameters = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.connection_recycle_time = 3600 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.connection_trace = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86252) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:00:01 devstack cinder-volume[86252]: WARNING cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:00:01 devstack cinder-volume[86252]: WARNING cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.db_inc_retry_interval = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.db_max_retries = 20 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.db_max_retry_interval = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.db_retry_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.max_overflow = 50 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.max_pool_size = 5 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.max_retries = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.mysql_wsrep_sync_wait = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.pool_timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.retry_interval = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.slave_connection = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.sqlite_synchronous = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.synchronous_reader = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] database.use_db_reconnect = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_tracing.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.connection_string = messaging:// {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.es_doc_type = notification {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.es_scroll_size = 10000 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.es_scroll_time = 2m {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.filter_error_trace = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.hmac_keys = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.sentinel_service_name = mymaster {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.socket_timeout = 0.1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.trace_requests = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler.trace_sqlalchemy = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler_jaeger.process_tags = {} {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler_jaeger.service_name_prefix = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] profiler_otlp.service_name_prefix = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.enforce_new_defaults = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.policy_default_rule = default {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.policy_file = policy.yaml {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_policy.remote_timeout = 60.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.group = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.helper_command = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] privsep_osbrick.user = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.group = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.helper_command = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] cinder_sys_admin.user = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.auth_section = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.auth_type = password {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.cafile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.collect_timing = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.send_service_user_token = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.split_loggers = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.tls_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] service_user.tls_min_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.auth_section = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.auth_type = password {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.collect_timing = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.region_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.split_loggers = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.tls_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] glance.tls_min_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.backend_availability_zone = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.chap_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.chap_username = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.disk_geometry = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_client_cert = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_client_cert_key = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_data_namespace = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.driver_use_ssl = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.enable_unsupported_driver = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.extra_capabilities = {} {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.filter_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.goodness_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iscsi_target_flags = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iscsi_write_cache = on {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iser_helper = tgtadm {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iser_port = 3260 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_host = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_login = admin {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_mount_options = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_private_key = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_share_path = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_ssh_port = 22 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.num_shell_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.nvmet_port_id = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_client_cfg = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.quobyte_volume_url = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.replication_device = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.report_discard_supported = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.reserved_percentage = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.scst_target_driver = iscsi {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.scst_target_iqn_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.storage_protocol = iSCSI {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_helper = tgtadm {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_port = 3260 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack quobyte-client[86261]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:00:01 devstack quobyte-client[86261]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_protocol = iscsi {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.trace_flags = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.unique_fqdn_network = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.use_chap_auth = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_backend_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_clear = zero {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_clear_ionice = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_clear_size = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_reports.file_event_handler = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_reports.log_dir = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.backend_availability_zone = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.backend_host = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.chap_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.chap_username = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.chiscsi_conf = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.disk_geometry = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_client_cert = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_client_cert_key = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_data_namespace = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.driver_use_ssl = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=86252) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.extra_capabilities = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.filter_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.goodness_function = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: INFO cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d ... Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 -c /etc/quobyte/client-cinder.cfg {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iscsi_target_flags = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iscsi_write_cache = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iser_helper = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iser_ip_address = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iser_port = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.iser_target_prefix = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_host = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_login = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_mount_options = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_password = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_private_key = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_share_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_ssh_port = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.num_shell_tries = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nvmet_ns_id = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.nvmet_port_id = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.replication_device = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.report_discard_supported = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.reserved_percentage = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.scst_target_driver = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.storage_protocol = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_helper = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_ip_address = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_port = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_prefix = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_protocol = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.trace_flags = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.unique_fqdn_network = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.use_chap_auth = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_clear = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_clear_ionice = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_clear_size = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] QuobyteHD.volumes_dir = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 -c /etc/quobyte/client-cinder.cfg Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.ssl_version = {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_notifications.driver = [] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_notifications.retry = -1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] oslo_messaging_notifications.transport_url = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] key_manager.fixed_key = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.barbican_api_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.barbican_endpoint = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.barbican_endpoint_type = public {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.barbican_region_name = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.cafile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.collect_timing = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.number_of_retries = 60 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.retry_delay = 1 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.send_service_user_token = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.split_loggers = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.tls_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.tls_min_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.verify_ssl = True {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican.verify_ssl_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.auth_section = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.auth_type = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.cafile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.certfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.collect_timing = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.insecure = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.keyfile = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.split_loggers = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.timeout = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.tls_ciphers = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] barbican_service_user.tls_min_version = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.approle_role_id = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.approle_secret_id = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.auth_method = approle {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.auth_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.kv_mountpoint = secret {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.kv_path = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.kv_version = 2 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.namespace = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.root_token_id = **** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.ssl_ca_crt_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.timeout = 60.0 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.token_file = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.token_role = None {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.use_ssl = False {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:01 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] ******************************************************************************** {{(pid=86054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:02 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.018s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:02 devstack cinder-volume[86252]: INFO cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d succeeded Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=86252) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.035s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:02 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:02 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:02 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.291s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:02 devstack cinder-volume[86252]: INFO cinder.volume.driver [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.volume.driver [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86252) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_db.sqlalchemy.engines [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86252) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG dbcounter [-] [86252] Writer thread running {{(pid=86252) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.db.api [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Building query based on filter {{(pid=86252) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.image.image_utils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86252) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:02 devstack cinder-volume[86252]: INFO cinder.keymgr.migration [None req-7dd27679-6665-42f8-b336-8a2ce241f7ae None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=86252) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=86252) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:02 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:02 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:02 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:03 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.282s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG cinder.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Notifying Schedulers of capabilities ... {{(pid=86252) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:03 devstack cinder-volume[86252]: INFO cinder.volume.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Driver initialization completed successfully. Sep 28 17:00:03 devstack cinder-volume[86252]: INFO cinder.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Initiating service 3 cleanup Sep 28 17:00:03 devstack cinder-volume[86252]: INFO cinder.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Service 3 cleanup completed. Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG cinder.service [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Creating RPC server for service cinder-volume {{(pid=86252) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG cinder.service [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86252) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:03 devstack cinder-volume[86252]: INFO cinder.volume.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=86252) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=86252) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:03 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:03 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:03 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:03 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.423s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:03 devstack cinder-volume[86252]: INFO cinder.volume.manager [None req-3a72f169-df76-4026-a4fa-639d3a50a0e5 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=86252) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG cinder.volume.drivers.quobyte [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=86252) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86252) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:08 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:08 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:08 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG oslo_concurrency.processutils [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.247s {{(pid=86252) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:08 devstack cinder-volume[86252]: DEBUG cinder.manager [None req-23f2c479-1330-4386-a8ed-334c6c5cdd6a None None] Notifying Schedulers of capabilities ... {{(pid=86252) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:10 devstack cinder-volume[86054]: DEBUG dbcounter [-] [86054] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:11 devstack cinder-volume[86054]: INFO oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Caught SIGTERM, stopping children Sep 28 17:00:11 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Acquiring lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:11 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Acquired lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:11 devstack cinder-volume[86054]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Releasing lock "singleton_lock" {{(pid=86054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:11 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Stop services. {{(pid=86054) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:00:11 devstack cinder-volume[86054]: DEBUG oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Killing children. {{(pid=86054) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:00:11 devstack cinder-volume[86054]: INFO oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Waiting on 1 children to exit Sep 28 17:00:13 devstack cinder-volume[86252]: DEBUG dbcounter [-] [86252] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86252) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:13 devstack cinder-volume[86252]: DEBUG dbcounter [-] [86252] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86252) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:16 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Acquiring lock "singleton_lock" {{(pid=86252) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:16 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Acquired lock "singleton_lock" {{(pid=86252) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:16 devstack cinder-volume[86252]: DEBUG oslo_concurrency.lockutils [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Releasing lock "singleton_lock" {{(pid=86252) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:16 devstack cinder-volume[86252]: WARNING amqp [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:16 devstack cinder-volume[86252]: WARNING amqp [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:16 devstack cinder-volume[86054]: INFO oslo_service.backend._eventlet.service [None req-8e09b9cc-2167-4bee-90d6-e2b0d16ec5cf None None] Child 86252 exited with status 0 Sep 28 17:00:17 devstack cinder-volume[86786]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:00:17 devstack cinder-volume[86786]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:00:17 devstack cinder-volume[86786]: we strongly recommend against using it for new projects. Sep 28 17:00:17 devstack cinder-volume[86786]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:00:17 devstack cinder-volume[86786]: framework. For more detail see Sep 28 17:00:17 devstack cinder-volume[86786]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:00:17 devstack cinder-volume[86786]: import eventlet # noqa Sep 28 17:00:19 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:19 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:19 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:20 devstack cinder-volume[86786]: INFO dbcounter [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Registered counter for database cinder Sep 28 17:00:20 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG dbcounter [-] [86786] Writer thread running {{(pid=86786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:21 devstack cinder-volume[86786]: INFO cinder.rpc [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:21 devstack cinder-volume[86786]: INFO cinder.rpc [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:21 devstack cinder-volume[86786]: INFO cinder.volume.manager [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Determined volume DB was empty at startup. Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG cinder.volume.manager [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86786) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:21 devstack cinder-volume[86786]: WARNING stevedore.named [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:21 devstack cinder-volume[86786]: WARNING castellan.key_manager [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:21 devstack cinder-volume[86786]: WARNING cinder.keymgr.conf_key_mgr [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:21 devstack cinder-volume[86786]: INFO cinder.volume.manager [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:21 devstack cinder-volume[86786]: INFO oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Starting 1 workers Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Started child 87034 {{(pid=86786) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Full set of CONF: {{(pid=86786) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] ******************************************************************************** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] Configuration options gathered from: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] ================================================================================ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] allow_availability_zone_fallback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[87034]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] allow_compression_on_image_upload = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] allowed_direct_url_schemes = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] api_rate_limit = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] auth_strategy = keystone {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_host = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_stats_polling_interval = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backup_api_class = cinder.backup.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backup_name_template = backup-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backup_use_same_host = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backup_use_temp_snapshot = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] chap_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] chap_username = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_internal_tenant_project_id = 6abe40316b21413eb8bf1207ed414b67 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_internal_tenant_user_id = d4243e162c6e4cdeac001e921bfb5313 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cluster = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] compression_format = gzip {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] compute_api_class = cinder.compute.nova.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] config_dir = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] config_source = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] control_exchange = openstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] debug = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] default_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] default_group_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] default_volume_type = QuobyteHD {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] disk_geometry = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_client_cert = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_client_cert_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_data_namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_ssl_cert_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_ssl_cert_verify = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] driver_use_ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] enable_new_services = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] enable_unsupported_driver = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] enabled_backends = ['QuobyteHD'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] enforce_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] filter_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_api_insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_api_servers = ['http://192.168.122.64/image'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_api_ssl_compression = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_ca_certificates_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_catalog_info = image:glance:publicURL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_num_retries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance_request_timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] goodness_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] graceful_shutdown_timeout = 5 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] group_api_class = cinder.group.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] host = devstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_compress_on_upload = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_conversion_address_space_limit = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_conversion_cpu_limit = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_conversion_disable = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_introspection_address_space_limit = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_introspection_cpu_limit = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_upload_use_cinder_backend = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_upload_use_internal_tenant = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_volume_cache_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_volume_cache_max_count = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] image_volume_cache_max_size_gb = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87034) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] init_host_max_objects_retrieval = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] instance_format = [instance: %(uuid)s] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iscsi_target_flags = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iscsi_write_cache = on {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iser_helper = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iser_ip_address = 192.168.122.64 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iser_port = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_color = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_config_append = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_dir = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_options = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_rotate_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_rotate_interval_type = days {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] log_rotation_type = none {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] max_age = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] max_logfile_count = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] max_logfile_size_mb = 200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] max_over_subscription_ratio = 20.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] message_reap_interval = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] message_ttl = 2592000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] migration_create_volume_timeout_secs = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] monkey_patch = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] monkey_patch_modules = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] my_ip = 192.168.122.64 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] no_snapshot_gb_quota = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] num_iser_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] num_shell_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] num_volume_device_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] nvmeof_conn_info_version = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] nvmet_ns_id = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] nvmet_port_id = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_max_limit = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_ext_list = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_listen_port = 8776 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_use_ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] osapi_volume_workers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] per_volume_size_limit = -1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] periodic_fuzzy_delay = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] periodic_interval = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] public_endpoint = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] publish_errors = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_backup_gigabytes = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_backups = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_gigabytes = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_groups = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_snapshots = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] quota_volumes = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] rate_limit_burst = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] rate_limit_except_level = CRITICAL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] rate_limit_interval = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] reinit_driver_count = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] replication_device = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] report_discard_supported = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] report_interval = 120 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] reservation_clean_interval = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] reservation_expire = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] reserved_image_namespaces = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] reserved_percentage = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] rpc_response_timeout = 120 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] run_external_periodic_tasks = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] scst_target_driver = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] scst_target_iqn_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_down_time = 720 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] shell_completion = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] snapshot_name_template = snapshot-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] state_path = /opt/stack/data/cinder {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] storage_availability_zone = nova {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] storage_protocol = iSCSI {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] syslog_log_facility = LOG_USER {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_helper = lioadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_ip_address = 192.168.122.64 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_port = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_protocol = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] target_secondary_ip_addresses = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] trace_flags = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] transport_url = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] until_refresh = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_chap_auth = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_default_quota_class = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_journal = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_json = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_stderr = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] use_syslog = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] verify_glance_signatures = enabled {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_api_class = cinder.volume.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_backend_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_clear = zero {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_clear_ionice = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_clear_size = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_copy_bps_limit = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_dd_blocksize = 1M {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_name_template = volume-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_service_inithost_offload = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volume_usage_audit_period = month {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] zoning_mode = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_concurrency.disable_process_locking = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.auth_type = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.auth_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.cache = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.include_service_catalog = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.interface = public {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcache_username = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.region_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.service_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.64/identity {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.backend = dogpile.cache.null {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.backend_argument = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.backend_expiration_time = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.config_prefix = cache.oslo {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.debug_cache_backend = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.enable_retry_client = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.enable_socket_keepalive = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.expiration_time = 600 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.hashclient_retry_attempts = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_dead_retry = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_pool_maxsize = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_sasl_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.proxies = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.redis_db = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.redis_server = localhost:6379 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.retry_attempts = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.retry_delay = 0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.socket_keepalive_count = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.socket_keepalive_idle = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87034) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.socket_keepalive_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.socket_timeout = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.tls_allowed_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.tls_cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.tls_certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:00:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.tls_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.tls_keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cache.username = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] coordination.backend_url = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.asyncio_connection = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.asyncio_slave_connection = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.backend = sqlalchemy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Running cmd (subprocess): mount.quobyte {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.connection = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.connection_debug = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.connection_parameters = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.connection_recycle_time = 3600 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.connection_trace = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.db_inc_retry_interval = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.db_max_retries = 20 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.db_max_retry_interval = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.db_retry_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.max_overflow = 50 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.max_pool_size = 5 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.max_retries = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.mysql_wsrep_sync_wait = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.pool_timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.retry_interval = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.slave_connection = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.sqlite_synchronous = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.synchronous_reader = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] database.use_db_reconnect = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_tracing.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.connection_string = messaging:// {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.es_doc_type = notification {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.es_scroll_size = 10000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.es_scroll_time = 2m {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.filter_error_trace = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.hmac_keys = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.sentinel_service_name = mymaster {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.socket_timeout = 0.1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.trace_requests = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler.trace_sqlalchemy = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler_jaeger.process_tags = {} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler_jaeger.service_name_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] profiler_otlp.service_name_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.enforce_new_defaults = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.policy_default_rule = default {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.policy_file = policy.yaml {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.group = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.helper_command = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] privsep_osbrick.user = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.group = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.helper_command = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] cinder_sys_admin.user = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.auth_type = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.collect_timing = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.send_service_user_token = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.tls_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] service_user.tls_min_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.auth_type = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.collect_timing = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.region_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.tls_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] glance.tls_min_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.backend_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.chap_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.chap_username = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.disk_geometry = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_client_cert = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_client_cert_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_data_namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.driver_use_ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.extra_capabilities = {} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.filter_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.goodness_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iscsi_target_flags = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iscsi_write_cache = on {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iser_helper = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iser_ip_address = 192.168.122.64 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iser_port = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_host = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_login = admin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_mount_options = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_private_key = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_share_path = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.num_shell_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.quobyte_volume_url = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.replication_device = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.report_discard_supported = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.reserved_percentage = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_helper = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_ip_address = 192.168.122.64 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_port = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_protocol = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.trace_flags = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.unique_fqdn_network = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.use_chap_auth = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_backend_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_clear = zero {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_clear_ionice = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_clear_size = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_reports.file_event_handler = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_reports.log_dir = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.backend_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.backend_host = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.chap_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.chap_username = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.chiscsi_conf = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.disk_geometry = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_client_cert = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_data_namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack quobyte-client[87038]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:00:21 devstack quobyte-client[87038]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.driver_use_ssl = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.extra_capabilities = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.filter_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.goodness_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iser_helper = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iser_ip_address = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iser_port = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.iser_target_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_host = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_login = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_mount_options = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_private_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_share_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_ssh_port = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.num_shell_tries = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.nvmet_port_id = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.replication_device = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.report_discard_supported = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.reserved_percentage = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.scst_target_driver = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.storage_protocol = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_helper = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_ip_address = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_port = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_protocol = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.trace_flags = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.use_chap_auth = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_clear = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_clear_size = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] QuobyteHD.volumes_dir = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_notifications.driver = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_notifications.retry = -1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] key_manager.fixed_key = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.barbican_api_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.barbican_endpoint = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.barbican_endpoint_type = public {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.barbican_region_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.collect_timing = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.number_of_retries = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.retry_delay = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.send_service_user_token = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.tls_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.tls_min_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.verify_ssl = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican.verify_ssl_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.auth_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.collect_timing = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.tls_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] barbican_service_user.tls_min_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.approle_role_id = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.approle_secret_id = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.auth_method = approle {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.auth_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.kv_mountpoint = secret {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.kv_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.kv_version = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.root_token_id = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.ssl_ca_crt_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.timeout = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.token_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.token_role = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.use_ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-379f3004-6ecd-49f0-9b05-0640f22c9370 None None] ******************************************************************************** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:21 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.268s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[87034]: INFO cinder.volume.driver [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.driver [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87034) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_db.sqlalchemy.engines [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writer thread running {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.db.api [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Building query based on filter {{(pid=87034) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87034) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack cinder-volume[87034]: INFO cinder.keymgr.migration [None req-d2fe3605-6f04-4640-a1da-978017d79070 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:21 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:21 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:22 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.242s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Driver initialization completed successfully. Sep 28 17:00:22 devstack cinder-volume[87034]: INFO cinder.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Initiating service 3 cleanup Sep 28 17:00:22 devstack cinder-volume[87034]: INFO cinder.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Service 3 cleanup completed. Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG cinder.service [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Creating RPC server for service cinder-volume {{(pid=87034) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG cinder.service [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87034) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:22 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:00:22 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:22 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.257s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-85a9dcfc-c1cb-4bb9-bd19-810651f6b557 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:31 devstack cinder-volume[86786]: DEBUG dbcounter [-] [86786] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:32 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:32 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 6 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:01:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Flow 'volume_create_manager' (4b646621-98d7-4466-b5a6-3abcab51654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdc3a5-fcbe-4c53-9ec0-1fff0ae1761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdc3a5-fcbe-4c53-9ec0-1fff0ae1761a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-867979603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f873a47d-53af-430d-bd50-df37eb0bb06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11beb9e4db84a23bb0aba14654e6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:23Z,use_quota=True,user_id='d74458c7500a4e9481acf4cbf7992b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e03bc1-458b-4617-ad3b-42ec62774cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e03bc1-458b-4617-ad3b-42ec62774cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6123ab06-73cc-4aef-a37c-87e1544a38f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6123ab06-73cc-4aef-a37c-87e1544a38f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f873a47d-53af-430d-bd50-df37eb0bb06e', 'volume_name': 'volume-f873a47d-53af-430d-bd50-df37eb0bb06e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3968800-0dc3-43b3-aa1a-04f9f95496ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3968800-0dc3-43b3-aa1a-04f9f95496ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a57f4e3-ca24-4dbe-b357-45eaa2f9adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Volume f873a47d-53af-430d-bd50-df37eb0bb06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f873a47d-53af-430d-bd50-df37eb0bb06e', 'volume_size': 1} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-867979603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f873a47d-53af-430d-bd50-df37eb0bb06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11beb9e4db84a23bb0aba14654e6023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:01:23Z,use_quota=True,user_id='d74458c7500a4e9481acf4cbf7992b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Creating volume f873a47d-53af-430d-bd50-df37eb0bb06e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:01:23 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:01:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:23 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e 1073741824 Sep 28 17:01:23 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:24 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e 1073741824" returned: 0 in 0.763s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:24 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e Sep 28 17:01:24 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:24 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e" returned: 0 in 0.280s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a57f4e3-ca24-4dbe-b357-45eaa2f9adfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f873a47d-53af-430d-bd50-df37eb0bb06e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea85df3d-dd9f-490d-829d-fc5a0ac06632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:01:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Volume volume-f873a47d-53af-430d-bd50-df37eb0bb06e (f873a47d-53af-430d-bd50-df37eb0bb06e): created successfully Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea85df3d-dd9f-490d-829d-fc5a0ac06632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:01:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Flow 'volume_create_manager' (4b646621-98d7-4466-b5a6-3abcab51654a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:01:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-385674af-0e62-40fc-a67a-3f5d34983fe9 tempest-TaggedAttachmentsTest-800927249 None] Created volume successfully. Sep 28 17:01:34 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:34 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.087s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:02 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:02:02 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:03 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.458s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 6 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:02:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Flow 'volume_create_manager' (336358ce-f40f-4fb1-b2c8-534f8a33eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b984f-f578-4469-8560-9ffa7fa5b326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b984f-f578-4469-8560-9ffa7fa5b326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1874329074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b958a5c9-676d-4ea7-9615-39eafb6f4332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee490ac9650043b6b92f79981359411a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:08Z,use_quota=True,user_id='31df9fbf47a2457aa2ad4c71d6b2d065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7986d7a6-9307-4358-88d5-5d31711a00ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7986d7a6-9307-4358-88d5-5d31711a00ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b63964-9d50-4a54-b7c8-64bbe6241560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b63964-9d50-4a54-b7c8-64bbe6241560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b958a5c9-676d-4ea7-9615-39eafb6f4332', 'volume_name': 'volume-b958a5c9-676d-4ea7-9615-39eafb6f4332', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b36ea0-905a-4bcf-84b2-ff1ab014e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b36ea0-905a-4bcf-84b2-ff1ab014e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a803fcbc-2189-4b9a-8f53-00231a2d737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Volume b958a5c9-676d-4ea7-9615-39eafb6f4332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b958a5c9-676d-4ea7-9615-39eafb6f4332', 'volume_size': 1} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1874329074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b958a5c9-676d-4ea7-9615-39eafb6f4332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee490ac9650043b6b92f79981359411a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:08Z,use_quota=True,user_id='31df9fbf47a2457aa2ad4c71d6b2d065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Creating volume b958a5c9-676d-4ea7-9615-39eafb6f4332 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:08 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:02:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:08 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 1073741824 Sep 28 17:02:08 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:09 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 1073741824" returned: 0 in 0.914s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:09 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 Sep 28 17:02:09 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:10 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332" returned: 0 in 0.803s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a803fcbc-2189-4b9a-8f53-00231a2d737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b958a5c9-676d-4ea7-9615-39eafb6f4332', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2587cfb7-789f-49e8-86b8-d15ae5b4f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Volume volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 (b958a5c9-676d-4ea7-9615-39eafb6f4332): created successfully Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2587cfb7-789f-49e8-86b8-d15ae5b4f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Flow 'volume_create_manager' (336358ce-f40f-4fb1-b2c8-534f8a33eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-476d602e-433e-4cf8-88f6-1c134a76a644 tempest-VolumesAdminNegativeTest-1863824083 None] Created volume successfully. Sep 28 17:02:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Acquiring lock "cinder-b958a5c9-676d-4ea7-9615-39eafb6f4332-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "cinder-b958a5c9-676d-4ea7-9615-39eafb6f4332-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Acquiring lock "cinder-quobyte-b958a5c9-676d-4ea7-9615-39eafb6f4332" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "cinder-quobyte-b958a5c9-676d-4ea7-9615-39eafb6f4332" acquired by "delete_volume" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:13 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxrz_bsnr/privsep.sock'] Sep 28 17:02:13 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxrz_bsnr/privsep.sock Sep 28 17:02:13 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:02:14 devstack cinder-volume[87034]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:02:15 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:15 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Spawned new privsep daemon via rootwrap Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Accepted privsep connection to /tmp/tmpxrz_bsnr/privsep.sock {{(pid=87034) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:02:15 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:02:15 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:02:15 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:02:15 devstack cinder-volume[87034]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88110 Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f7f6d1-a20c-4f98-b2af-9e6299a4f23f]: (2,) {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eae22f-4359-4c4c-9d0d-14c35f69797a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:15 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 Sep 28 17:02:15 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:15 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332" returned: 0 in 0.683s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:15 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332 Sep 28 17:02:15 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:16 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b958a5c9-676d-4ea7-9615-39eafb6f4332" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "cinder-quobyte-b958a5c9-676d-4ea7-9615-39eafb6f4332" released by "delete_volume" :: held 3.153s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:16 devstack cinder-volume[87034]: WARNING cinder.quota [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:16 devstack cinder-volume[87034]: WARNING cinder.quota [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Created reservations ['898d81ed-9f04-45c4-824a-4950739a205b', 'fbe2b8fb-84e2-42ea-a66e-910b3c6778c5', '612b487b-d384-4f52-bc06-8851a15d123f', '16194ce2-21b7-4226-8340-9078155ec404'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:16 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:02:16 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:17 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.531s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:17 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Deleted volume successfully. Sep 28 17:02:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b6066fa-315b-45e4-b705-c6a22e905183 tempest-VolumesAdminNegativeTest-1863824083 None] Lock "cinder-b958a5c9-676d-4ea7-9615-39eafb6f4332-delete_volume" released by "delete_volume" :: held 4.422s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (ffe87846-5d5e-4119-8513-1bed08818207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802a7814-6761-46c9-bbe0-9441bbbe07ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802a7814-6761-46c9-bbe0-9441bbbe07ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-329649775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d35d29-b68a-4881-bf36-89e5b93b8d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:22Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b3c266-b300-4700-baab-a297a41c1127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b3c266-b300-4700-baab-a297a41c1127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92276eb-4015-46b3-a6d0-f27911deb660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92276eb-4015-46b3-a6d0-f27911deb660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d35d29-b68a-4881-bf36-89e5b93b8d85', 'volume_name': 'volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c39b73-c716-426f-a83f-281b21bab115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c39b73-c716-426f-a83f-281b21bab115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b30f87-c2c4-440d-9b89-9a4d6daf68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Volume e1d35d29-b68a-4881-bf36-89e5b93b8d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85', 'volume_size': 1} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-329649775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d35d29-b68a-4881-bf36-89e5b93b8d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:22Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Creating volume e1d35d29-b68a-4881-bf36-89e5b93b8d85 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:02:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:21 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 1073741824 Sep 28 17:02:21 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:22 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 1073741824" returned: 0 in 1.081s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:23 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 Sep 28 17:02:23 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:23 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85" returned: 0 in 0.524s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b30f87-c2c4-440d-9b89-9a4d6daf68ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c71012-2bce-4f1f-b53a-375b4ec68aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Volume volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 (e1d35d29-b68a-4881-bf36-89e5b93b8d85): created successfully Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c71012-2bce-4f1f-b53a-375b4ec68aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (ffe87846-5d5e-4119-8513-1bed08818207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dbaf0fc6-56e4-4eb3-84c6-60776d1fc239 tempest-AttachVolumeTestJSON-1710320888 None] Created volume successfully. Sep 28 17:02:27 devstack cinder-volume[87034]: WARNING py.warnings [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:02:27 devstack cinder-volume[87034]: .first() Sep 28 17:02:27 devstack cinder-volume[87034]: Sep 28 17:02:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cf933e3-566e-4791-874c-97f496c53ce9', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:02:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-a9f83e2b-ec9a-4dd5-a389-c69bf10cbe18 req-5e220ba8-583f-468e-afbe-cc36234bacb3 tempest-AttachVolumeTestJSON-1710320888 None] attachment_update completed successfully. Sep 28 17:02:37 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:37 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=19,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-83f330a1-fb60-4fa0-bec9-2ef71874e05a req-2365c31b-c70f-4077-998f-7910c2b71c9a tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-83f330a1-fb60-4fa0-bec9-2ef71874e05a req-2365c31b-c70f-4077-998f-7910c2b71c9a tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-83f330a1-fb60-4fa0-bec9-2ef71874e05a req-2365c31b-c70f-4077-998f-7910c2b71c9a tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-83f330a1-fb60-4fa0-bec9-2ef71874e05a req-2365c31b-c70f-4077-998f-7910c2b71c9a tempest-TaggedAttachmentsTest-800927249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-f873a47d-53af-430d-bd50-df37eb0bb06e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56aad1a3-affd-49cb-91a4-faed68b443e5', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:02:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-83f330a1-fb60-4fa0-bec9-2ef71874e05a req-2365c31b-c70f-4077-998f-7910c2b71c9a tempest-TaggedAttachmentsTest-800927249 None] attachment_update completed successfully. Sep 28 17:02:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-fedbe33e-22ae-4125-bce1-e4add2f7389a req-75f0c7bc-a36d-4bcb-843b-766cb04dcf2e tempest-TaggedAttachmentsTest-800927249 None] Terminate volume connection completed successfully. Sep 28 17:02:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-fedbe33e-22ae-4125-bce1-e4add2f7389a req-75f0c7bc-a36d-4bcb-843b-766cb04dcf2e tempest-TaggedAttachmentsTest-800927249 None] Deleting attachment 56aad1a3-affd-49cb-91a4-faed68b443e5. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:02:52 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:57 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:02 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:03:02 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:03 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.493s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 8 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:03:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "cinder-f873a47d-53af-430d-bd50-df37eb0bb06e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "cinder-f873a47d-53af-430d-bd50-df37eb0bb06e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "cinder-quobyte-f873a47d-53af-430d-bd50-df37eb0bb06e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "cinder-quobyte-f873a47d-53af-430d-bd50-df37eb0bb06e" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0eb23-17bc-4007-adc7-f70605f76fef]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:06 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e Sep 28 17:03:06 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:06 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e" returned: 0 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:06 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e Sep 28 17:03:06 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:06 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f873a47d-53af-430d-bd50-df37eb0bb06e" returned: 0 in 0.260s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "cinder-quobyte-f873a47d-53af-430d-bd50-df37eb0bb06e" released by "delete_volume" :: held 0.717s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Created reservations ['96c31273-a77f-4e01-a9b2-8d84e075ed9b', 'f65adecc-30c7-4b16-9bdf-38ab01596f31', '8d6ab5bd-72b0-439a-a1fd-c0bb26b3b527', '25655198-4fd8-4cb3-8977-f4efb4c9015e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:06 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:03:06 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:07 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.332s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Deleted volume successfully. Sep 28 17:03:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a37661b-9940-4ee0-a1c0-ccaa8e51277b tempest-TaggedAttachmentsTest-800927249 None] Lock "cinder-f873a47d-53af-430d-bd50-df37eb0bb06e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:03:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-28f415d6-8637-4bd6-a437-fe6a1c3285f9 req-a494f55a-7040-4093-9866-5b3b7f0a6d27 tempest-AttachVolumeTestJSON-1710320888 None] Terminate volume connection completed successfully. Sep 28 17:03:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-28f415d6-8637-4bd6-a437-fe6a1c3285f9 req-a494f55a-7040-4093-9866-5b3b7f0a6d27 tempest-AttachVolumeTestJSON-1710320888 None] Deleting attachment 1cf933e3-566e-4791-874c-97f496c53ce9. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:03:18 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Flow 'volume_create_manager' (15eaec31-4d5e-4b71-9284-b3b082b479e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5bdbdd-e142-425b-80a2-b6850a564949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5bdbdd-e142-425b-80a2-b6850a564949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-834559448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cdcc27-6a66-4e1b-8a09-851911f10c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0629ac39fb4d34b9f9abbcf38a1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:19Z,use_quota=True,user_id='9675e5cfbb6542c080ae0733ae8a50b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a7672d-e005-48c7-b0f8-edc8ddee26c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a7672d-e005-48c7-b0f8-edc8ddee26c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e154bc-d6e2-4c2a-a259-41d8101e0425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e154bc-d6e2-4c2a-a259-41d8101e0425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'volume_name': 'volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b77eb9-e5d8-4761-a695-b592d93d5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b77eb9-e5d8-4761-a695-b592d93d5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf951283-6c62-4b07-b79c-37953715ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:19 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Volume e0cdcc27-6a66-4e1b-8a09-851911f10c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'volume_size': 1} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-834559448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cdcc27-6a66-4e1b-8a09-851911f10c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0629ac39fb4d34b9f9abbcf38a1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:19Z,use_quota=True,user_id='9675e5cfbb6542c080ae0733ae8a50b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Creating volume e0cdcc27-6a66-4e1b-8a09-851911f10c7e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:19 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:03:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:19 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e 1073741824 Sep 28 17:03:19 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:20 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e 1073741824" returned: 0 in 1.097s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:20 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e Sep 28 17:03:20 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:20 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf951283-6c62-4b07-b79c-37953715ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2893433f-f0f3-44c6-9a3f-bbbdd7c9a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Volume volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e (e0cdcc27-6a66-4e1b-8a09-851911f10c7e): created successfully Sep 28 17:03:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2893433f-f0f3-44c6-9a3f-bbbdd7c9a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Flow 'volume_create_manager' (15eaec31-4d5e-4b71-9284-b3b082b479e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f2f4fb67-938d-4ff5-8501-f85a359b540b tempest-ServerActionsTestOtherA-782554590 None] Created volume successfully. Sep 28 17:03:31 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:31 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Flow 'volume_create_manager' (45c8c034-f686-4000-a73e-026eed304e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc334f8-c1ac-43b8-832e-79c10cc1aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc334f8-c1ac-43b8-832e-79c10cc1aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1943182511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a048e855-e5e2-4a96-80bc-a8abccb3c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf817995de7411bb804267e4ab5c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:37Z,use_quota=True,user_id='6c0fb362af0c44718883203ae6b761c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e3f096-8ece-4324-b36f-4dd6cc5e4554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e3f096-8ece-4324-b36f-4dd6cc5e4554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e148ab-e152-4c28-ab8c-04d54fc407be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e148ab-e152-4c28-ab8c-04d54fc407be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a048e855-e5e2-4a96-80bc-a8abccb3c4d3', 'volume_name': 'volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67bdb03-8e2d-4c65-8341-c05e4b886172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67bdb03-8e2d-4c65-8341-c05e4b886172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196730f5-f16a-467e-8bb0-0bb689457978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Volume a048e855-e5e2-4a96-80bc-a8abccb3c4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3', 'volume_size': 1} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1943182511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a048e855-e5e2-4a96-80bc-a8abccb3c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf817995de7411bb804267e4ab5c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:37Z,use_quota=True,user_id='6c0fb362af0c44718883203ae6b761c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Creating volume a048e855-e5e2-4a96-80bc-a8abccb3c4d3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:36 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:03:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:37 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 1073741824 Sep 28 17:03:37 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:38 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 1073741824" returned: 0 in 1.265s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:38 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 Sep 28 17:03:38 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:38 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196730f5-f16a-467e-8bb0-0bb689457978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1eb958-ecca-42c1-8aa0-bfd5c13d39c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Volume volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 (a048e855-e5e2-4a96-80bc-a8abccb3c4d3): created successfully Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1eb958-ecca-42c1-8aa0-bfd5c13d39c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Flow 'volume_create_manager' (45c8c034-f686-4000-a73e-026eed304e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-94311390-99a8-4a7b-8c3d-931a25ad0897 tempest-DeleteServersTestJSON-197800488 None] Created volume successfully. Sep 28 17:03:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-2dbb8ee9-1aa1-4592-b8f2-eda2bcdb4375 req-9b797ead-70d4-4fa1-b874-092128fef5bf tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-2dbb8ee9-1aa1-4592-b8f2-eda2bcdb4375 req-9b797ead-70d4-4fa1-b874-092128fef5bf tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-2dbb8ee9-1aa1-4592-b8f2-eda2bcdb4375 req-9b797ead-70d4-4fa1-b874-092128fef5bf tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-2dbb8ee9-1aa1-4592-b8f2-eda2bcdb4375 req-9b797ead-70d4-4fa1-b874-092128fef5bf tempest-DeleteServersTestJSON-197800488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baf7ea01-ebf7-4296-b1bc-8620bddfbbcf', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:03:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-2dbb8ee9-1aa1-4592-b8f2-eda2bcdb4375 req-9b797ead-70d4-4fa1-b874-092128fef5bf tempest-DeleteServersTestJSON-197800488 None] attachment_update completed successfully. Sep 28 17:03:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-7690673f-4a6c-4cb7-8a10-0715048aab0d req-eda41c6c-07bb-4958-a410-b98a7be59a36 tempest-DeleteServersTestJSON-197800488 None] Terminate volume connection completed successfully. Sep 28 17:03:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-7690673f-4a6c-4cb7-8a10-0715048aab0d req-eda41c6c-07bb-4958-a410-b98a7be59a36 tempest-DeleteServersTestJSON-197800488 None] Deleting attachment baf7ea01-ebf7-4296-b1bc-8620bddfbbcf. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "cinder-a048e855-e5e2-4a96-80bc-a8abccb3c4d3-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "cinder-a048e855-e5e2-4a96-80bc-a8abccb3c4d3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "cinder-quobyte-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "cinder-quobyte-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd08697f-60e7-4ced-9c0a-ab2fb9a7511f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:51 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 Sep 28 17:03:51 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:52 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" returned: 0 in 0.738s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:52 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3 Sep 28 17:03:52 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:53 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" returned: 0 in 0.598s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "cinder-quobyte-a048e855-e5e2-4a96-80bc-a8abccb3c4d3" released by "delete_volume" :: held 1.438s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Created reservations ['ad95e899-5950-4863-96b8-6bafa1088e0f', '04018bab-97d4-42d7-8334-8a1ce3079486', '1fb9d08d-bad1-4d3d-b04b-faaf4faeeca8', 'e31e6957-2f47-4c44-b19d-233fcaf5357d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:53 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:03:53 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:53 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.412s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Deleted volume successfully. Sep 28 17:03:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6cddb6ba-b49d-4e49-a22f-a2321e01e523 tempest-DeleteServersTestJSON-197800488 None] Lock "cinder-a048e855-e5e2-4a96-80bc-a8abccb3c4d3-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:02 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:04:02 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:03 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:03 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=12,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:03 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (ab8238a1-d371-49e3-9351-b8f065e6b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d749a507-3d77-4aff-a71d-454b41e19562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d749a507-3d77-4aff-a71d-454b41e19562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-496464429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aed3473-58ff-465a-a736-70f15ad7e468,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:08Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c47490-9f42-44e8-b53b-b15ceada97b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c47490-9f42-44e8-b53b-b15ceada97b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaad74dd-7e35-4cec-8309-1aa7b6975819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaad74dd-7e35-4cec-8309-1aa7b6975819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aed3473-58ff-465a-a736-70f15ad7e468', 'volume_name': 'volume-5aed3473-58ff-465a-a736-70f15ad7e468', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff6b909-5fbc-491a-a37a-57489065aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff6b909-5fbc-491a-a37a-57489065aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea823da-d501-4ae9-a622-c5f11848095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Volume 5aed3473-58ff-465a-a736-70f15ad7e468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aed3473-58ff-465a-a736-70f15ad7e468', 'volume_size': 1} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-496464429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aed3473-58ff-465a-a736-70f15ad7e468,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:08Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Creating volume 5aed3473-58ff-465a-a736-70f15ad7e468 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:08 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:04:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:08 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 1073741824 Sep 28 17:04:08 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:09 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 1073741824" returned: 0 in 0.918s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:09 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 Sep 28 17:04:09 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-21c75a10-20c4-4dae-83ef-1d904ffbd79d req-8e302c8f-db00-46d3-b5df-7591971ff207 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:10 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-21c75a10-20c4-4dae-83ef-1d904ffbd79d req-8e302c8f-db00-46d3-b5df-7591971ff207 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.155s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea823da-d501-4ae9-a622-c5f11848095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aed3473-58ff-465a-a736-70f15ad7e468', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f10617-69bf-436a-9564-d037a7b9678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Volume volume-5aed3473-58ff-465a-a736-70f15ad7e468 (5aed3473-58ff-465a-a736-70f15ad7e468): created successfully Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f10617-69bf-436a-9564-d037a7b9678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (ab8238a1-d371-49e3-9351-b8f065e6b516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-21c75a10-20c4-4dae-83ef-1d904ffbd79d req-8e302c8f-db00-46d3-b5df-7591971ff207 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.188s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2906cb5f-0931-44ff-b440-6fc02264ee39 tempest-VolumesTestJSON-773444154 None] Created volume successfully. Sep 28 17:04:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-21c75a10-20c4-4dae-83ef-1d904ffbd79d req-8e302c8f-db00-46d3-b5df-7591971ff207 tempest-ServerActionsTestOtherA-782554590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f856639-72db-4de9-9d4f-8b679e28c1bd', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:04:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-21c75a10-20c4-4dae-83ef-1d904ffbd79d req-8e302c8f-db00-46d3-b5df-7591971ff207 tempest-ServerActionsTestOtherA-782554590 None] attachment_update completed successfully. Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (20c678d3-8b52-4acb-9577-3f2846a27db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d39eca-a771-469b-a332-79daeb112e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d39eca-a771-469b-a332-79daeb112e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1791621668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:12Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b44771-2b88-46b7-b374-18cf4dc303ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b44771-2b88-46b7-b374-18cf4dc303ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c994c053-0876-4796-a068-009890ed969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c994c053-0876-4796-a068-009890ed969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b', 'volume_name': 'volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456e8c0-1017-492a-b6f3-531929e0d7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456e8c0-1017-492a-b6f3-531929e0d7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe316c8-270a-4f8c-9a2b-0eccd9572dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:12 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Volume 1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b', 'volume_size': 1} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1791621668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:12Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Creating volume 1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:12 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:04:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:12 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b 1073741824 Sep 28 17:04:12 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:13 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b 1073741824" returned: 0 in 0.997s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:13 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b Sep 28 17:04:13 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:14 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" returned: 0 in 0.617s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe316c8-270a-4f8c-9a2b-0eccd9572dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a6c169-b599-4721-97f2-93dd08e62dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:14 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Volume volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b (1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b): created successfully Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a6c169-b599-4721-97f2-93dd08e62dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (20c678d3-8b52-4acb-9577-3f2846a27db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-574f138a-84a3-4160-97fb-0cf6ffdec8fc tempest-VolumesTestJSON-773444154 None] Created volume successfully. Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (269fb8cd-b7e2-4db8-bf63-cce7c7b7d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad407e8-c9f9-45c0-8a34-c76170afa014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad407e8-c9f9-45c0-8a34-c76170afa014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779862323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ef99e-a637-4d7c-a38e-aae9452761b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:20Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9391f9d2-5c01-4acd-960d-8a732e23a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9391f9d2-5c01-4acd-960d-8a732e23a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c357196-7d56-4a4d-84b0-6d19f9a42ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c357196-7d56-4a4d-84b0-6d19f9a42ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1ef99e-a637-4d7c-a38e-aae9452761b6', 'volume_name': 'volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f8da3f-c3cf-4f54-8228-927591b75121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f8da3f-c3cf-4f54-8228-927591b75121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b7f180-25d9-4299-b41e-28ea2b6d9bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Volume 0c1ef99e-a637-4d7c-a38e-aae9452761b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6', 'volume_size': 1} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-779862323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ef99e-a637-4d7c-a38e-aae9452761b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d488a54cb8044c0b8d8606d1d8fcf554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:20Z,use_quota=True,user_id='01ef31b2fddc49e4a3e294bf17a7be61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Creating volume 0c1ef99e-a637-4d7c-a38e-aae9452761b6 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:20 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:04:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:20 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 1073741824 Sep 28 17:04:20 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:21 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 1073741824" returned: 0 in 1.192s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-0b461462-b8de-45a7-93ec-147d459b5964 req-32fd1004-515c-4889-98e4-26073ac88754 tempest-ServerActionsTestOtherA-782554590 None] Terminate volume connection completed successfully. Sep 28 17:04:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-0b461462-b8de-45a7-93ec-147d459b5964 req-32fd1004-515c-4889-98e4-26073ac88754 tempest-ServerActionsTestOtherA-782554590 None] Deleting attachment 0f856639-72db-4de9-9d4f-8b679e28c1bd. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:04:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:21 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 Sep 28 17:04:21 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:22 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6" returned: 0 in 0.574s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b7f180-25d9-4299-b41e-28ea2b6d9bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e929a5-07a9-4e92-bd1c-3be9d5e9f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Volume volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 (0c1ef99e-a637-4d7c-a38e-aae9452761b6): created successfully Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e929a5-07a9-4e92-bd1c-3be9d5e9f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Flow 'volume_create_manager' (269fb8cd-b7e2-4db8-bf63-cce7c7b7d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bffcfefb-328a-456d-b2d2-6b6ddf6df95d tempest-VolumesTestJSON-773444154 None] Created volume successfully. Sep 28 17:04:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0b461462-b8de-45a7-93ec-147d459b5964 req-2253121f-8dc8-4b15-8f4d-c2ca13b36b5a tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0b461462-b8de-45a7-93ec-147d459b5964 req-2253121f-8dc8-4b15-8f4d-c2ca13b36b5a tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0b461462-b8de-45a7-93ec-147d459b5964 req-2253121f-8dc8-4b15-8f4d-c2ca13b36b5a tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-0b461462-b8de-45a7-93ec-147d459b5964 req-2253121f-8dc8-4b15-8f4d-c2ca13b36b5a tempest-ServerActionsTestOtherA-782554590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1caaee65-66b6-4334-b916-3e3f5d7652f2', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:04:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-0b461462-b8de-45a7-93ec-147d459b5964 req-2253121f-8dc8-4b15-8f4d-c2ca13b36b5a tempest-ServerActionsTestOtherA-782554590 None] attachment_update completed successfully. Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-0c1ef99e-a637-4d7c-a38e-aae9452761b6-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "cinder-0c1ef99e-a637-4d7c-a38e-aae9452761b6-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-quobyte-0c1ef99e-a637-4d7c-a38e-aae9452761b6" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-0c1ef99e-a637-4d7c-a38e-aae9452761b6" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[927fe3f8-c160-465c-be83-02e5b3727cc8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:29 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 Sep 28 17:04:29 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:29 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6" returned: 0 in 1.160s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:29 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6 Sep 28 17:04:29 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:30 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0c1ef99e-a637-4d7c-a38e-aae9452761b6" returned: 0 in 0.666s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-0c1ef99e-a637-4d7c-a38e-aae9452761b6" released by "delete_volume" :: held 1.930s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Created reservations ['cc9b6441-31d7-47e0-ae20-6b274edf9ce1', '98817a49-2b2f-41c0-8a2a-54f7a7ae025f', '706998bb-7ce1-4748-8074-565c3960d188', '0eec1826-9cf2-4647-89d1-29d1e4f2f18a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:31 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:04:31 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "cinder-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-quobyte-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" acquired by "delete_volume" :: waited 0.059s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ca2767-8bee-4504-a68a-f336f96ce855]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:32 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 1.003s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:32 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Deleted volume successfully. Sep 28 17:04:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b1215ab6-98a1-4d93-b224-1fb3effb092f tempest-VolumesTestJSON-773444154 None] Lock "cinder-0c1ef99e-a637-4d7c-a38e-aae9452761b6-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:32 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b Sep 28 17:04:32 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:32 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" returned: 0 in 1.215s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:32 devstack sudo[91984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b Sep 28 17:04:32 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:33 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" returned: 0 in 0.633s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b" released by "delete_volume" :: held 2.018s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Created reservations ['89bbbccd-aa04-4aa6-9ea1-ac71dc5d678d', 'c493f583-7f07-4f24-95c8-f521948ecbcb', 'a34c224e-1bef-48dd-83bf-da34fc09afa3', '94a57391-2684-457a-adc8-39f87817f36a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:33 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:04:33 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:34 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.439s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Deleted volume successfully. Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03c49cf5-90a8-4038-b683-bb37cb3f8a07 tempest-VolumesTestJSON-773444154 None] Lock "cinder-1b8ab9ad-07ac-4769-9bfc-8ce0ec3d9f8b-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-5aed3473-58ff-465a-a736-70f15ad7e468-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "cinder-5aed3473-58ff-465a-a736-70f15ad7e468-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Acquiring lock "cinder-quobyte-5aed3473-58ff-465a-a736-70f15ad7e468" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-5aed3473-58ff-465a-a736-70f15ad7e468" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5382a-3509-45a9-abc6-8ac1fc6f69bd]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:35 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 Sep 28 17:04:35 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:35 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468" returned: 0 in 0.781s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:35 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468 Sep 28 17:04:35 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:36 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5aed3473-58ff-465a-a736-70f15ad7e468" returned: 0 in 0.998s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "cinder-quobyte-5aed3473-58ff-465a-a736-70f15ad7e468" released by "delete_volume" :: held 1.880s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:36 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Created reservations ['18bf8a2d-1f43-442a-b2c0-d25255a3c90d', 'a89e3891-2cf1-4c49-b184-2c10773e0762', '9314a092-fb8f-4757-94b7-1bdea508533d', '25f1ed4f-bf54-4d26-a9d3-1a68bda4ab0d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:37 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:04:37 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:37 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Deleted volume successfully. Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b3c060c0-c8ad-4834-867d-4bde6118c1dd tempest-VolumesTestJSON-773444154 None] Lock "cinder-5aed3473-58ff-465a-a736-70f15ad7e468-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:37 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Flow 'volume_create_manager' (b5d7fea2-dcfc-4ad6-9540-3ee402d1dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae2f86-47b5-4f46-ba0b-db7b6c6d8286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae2f86-47b5-4f46-ba0b-db7b6c6d8286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2043151800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2efa210-5f19-452f-9830-9fcb30967dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88435d8b33d849afa0027ea1f9409dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:38Z,use_quota=True,user_id='f4576e5b13d94e04adbfd3a27c069f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad3d2f-44e5-40f1-a8c9-24e60221b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ad3d2f-44e5-40f1-a8c9-24e60221b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e640484-3e2a-4943-af18-deb6622fc90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e640484-3e2a-4943-af18-deb6622fc90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2efa210-5f19-452f-9830-9fcb30967dac', 'volume_name': 'volume-c2efa210-5f19-452f-9830-9fcb30967dac', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d8cef2-bcbf-4594-9dc4-4105d794665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d8cef2-bcbf-4594-9dc4-4105d794665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78181718-fbb0-4346-9b04-0a312e70feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Volume c2efa210-5f19-452f-9830-9fcb30967dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2efa210-5f19-452f-9830-9fcb30967dac', 'volume_size': 1} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2043151800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2efa210-5f19-452f-9830-9fcb30967dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88435d8b33d849afa0027ea1f9409dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:38Z,use_quota=True,user_id='f4576e5b13d94e04adbfd3a27c069f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Creating volume c2efa210-5f19-452f-9830-9fcb30967dac {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:04:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:38 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac 1073741824 Sep 28 17:04:38 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:39 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac 1073741824" returned: 0 in 1.011s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:39 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac Sep 28 17:04:39 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:39 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac" returned: 0 in 0.436s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78181718-fbb0-4346-9b04-0a312e70feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2efa210-5f19-452f-9830-9fcb30967dac', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fad6762-3103-42e6-a579-9fd80b8b69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Volume volume-c2efa210-5f19-452f-9830-9fcb30967dac (c2efa210-5f19-452f-9830-9fcb30967dac): created successfully Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fad6762-3103-42e6-a579-9fd80b8b69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Flow 'volume_create_manager' (b5d7fea2-dcfc-4ad6-9540-3ee402d1dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3cb99899-0d7d-4287-89e7-1414a8f30328 tempest-ServerRescueNegativeTestJSON-1693497155 None] Created volume successfully. Sep 28 17:04:49 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:49 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=39,cinder:UPDATE=35,cinder:DELETE=6,cinder:INSERT=7 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (a509f7b0-cf89-46c8-a9a2-fca8aae5e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ca4be-a3de-45b0-8126-badc57f09795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401ca4be-a3de-45b0-8126-badc57f09795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-104625283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973fd0e7-4079-4b87-bed9-448ae797402e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:55Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9d48e-b7fd-4b5d-9d5a-fd2f75a83d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d9d48e-b7fd-4b5d-9d5a-fd2f75a83d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e83128-fedf-4ece-a32b-3d8980489834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e83128-fedf-4ece-a32b-3d8980489834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973fd0e7-4079-4b87-bed9-448ae797402e', 'volume_name': 'volume-973fd0e7-4079-4b87-bed9-448ae797402e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5efeea3-ec39-4329-ae89-d9fac6472421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5efeea3-ec39-4329-ae89-d9fac6472421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7643d60-6293-46c0-9ff2-ebc474b2bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Volume 973fd0e7-4079-4b87-bed9-448ae797402e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973fd0e7-4079-4b87-bed9-448ae797402e', 'volume_size': 1} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-104625283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973fd0e7-4079-4b87-bed9-448ae797402e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:55Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Creating volume 973fd0e7-4079-4b87-bed9-448ae797402e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:55 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:04:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:55 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e 1073741824 Sep 28 17:04:55 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Acquiring lock "cinder-c2efa210-5f19-452f-9830-9fcb30967dac-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "cinder-c2efa210-5f19-452f-9830-9fcb30967dac-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Acquiring lock "cinder-quobyte-c2efa210-5f19-452f-9830-9fcb30967dac" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "cinder-quobyte-c2efa210-5f19-452f-9830-9fcb30967dac" acquired by "delete_volume" :: waited 0.056s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[67481051-024d-4943-9e6f-10e941de7ad6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:56 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac Sep 28 17:04:56 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:56 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e 1073741824" returned: 0 in 1.194s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:56 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e Sep 28 17:04:56 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:57 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac" returned: 0 in 0.629s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:57 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac Sep 28 17:04:57 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:57 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e" returned: 0 in 0.457s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7643d60-6293-46c0-9ff2-ebc474b2bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973fd0e7-4079-4b87-bed9-448ae797402e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36e1bd-b6b1-472b-82e4-a7e54e4efb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Volume volume-973fd0e7-4079-4b87-bed9-448ae797402e (973fd0e7-4079-4b87-bed9-448ae797402e): created successfully Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca36e1bd-b6b1-472b-82e4-a7e54e4efb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (a509f7b0-cf89-46c8-a9a2-fca8aae5e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:57 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2efa210-5f19-452f-9830-9fcb30967dac" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "cinder-quobyte-c2efa210-5f19-452f-9830-9fcb30967dac" released by "delete_volume" :: held 1.142s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1a65844d-8199-4f20-9a1a-9f16a7550fa5 tempest-AttachVolumeTestJSON-1710320888 None] Created volume successfully. Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Created reservations ['bdbc6c2a-60b8-4c84-a436-7edd44533c3e', '9bdcb042-4184-4706-9ddb-a740f785868e', '46586fc9-4974-4120-8b7b-f7654c1b287c', '1ef80687-a0de-493f-956b-7b4208a7c036'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:57 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:04:57 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:57 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.295s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Deleted volume successfully. Sep 28 17:04:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f56859a-448a-4ede-83d5-4143b105a14a tempest-ServerRescueNegativeTestJSON-1693497155 None] Lock "cinder-c2efa210-5f19-452f-9830-9fcb30967dac-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3f0d1abc-1e28-46fb-ab32-ee5dee62936a req-38389099-0e1e-47ca-8f65-356a643e3cbb tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3f0d1abc-1e28-46fb-ab32-ee5dee62936a req-38389099-0e1e-47ca-8f65-356a643e3cbb tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3f0d1abc-1e28-46fb-ab32-ee5dee62936a req-38389099-0e1e-47ca-8f65-356a643e3cbb tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-3f0d1abc-1e28-46fb-ab32-ee5dee62936a req-38389099-0e1e-47ca-8f65-356a643e3cbb tempest-AttachVolumeTestJSON-1710320888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-973fd0e7-4079-4b87-bed9-448ae797402e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83454d83-b597-4a3c-a575-54c2cfd91f40', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:05:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-3f0d1abc-1e28-46fb-ab32-ee5dee62936a req-38389099-0e1e-47ca-8f65-356a643e3cbb tempest-AttachVolumeTestJSON-1710320888 None] attachment_update completed successfully. Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:02 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:05:02 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:03 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.410s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 8 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:05:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (ac81f4f2-374f-4458-a57b-7686dee1bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03168600-2375-47bf-a316-dd90c8872006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03168600-2375-47bf-a316-dd90c8872006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-242872565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d23d7d0-58ab-471b-8378-0267f9d3fa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:04Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a7126-ae32-465a-9fe3-66a94d125a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a7126-ae32-465a-9fe3-66a94d125a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f672b35f-b90e-4025-ab2d-f5ed56c99aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f672b35f-b90e-4025-ab2d-f5ed56c99aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d23d7d0-58ab-471b-8378-0267f9d3fa60', 'volume_name': 'volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1beedc5-fdda-4221-ba67-cae9879fd7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1beedc5-fdda-4221-ba67-cae9879fd7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65636c-6657-4557-a297-15769ba3277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:04 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Volume 6d23d7d0-58ab-471b-8378-0267f9d3fa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60', 'volume_size': 1} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-242872565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d23d7d0-58ab-471b-8378-0267f9d3fa60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66d71f877244e1ca7a8a5bc0c1fc227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:04Z,use_quota=True,user_id='043bc4fc535e4fa8bd17a073c3f2bcfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Creating volume 6d23d7d0-58ab-471b-8378-0267f9d3fa60 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:04 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:05:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:04 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 1073741824 Sep 28 17:05:04 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:05 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 1073741824" returned: 0 in 0.768s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:05 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 Sep 28 17:05:05 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:05 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60" returned: 0 in 0.475s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65636c-6657-4557-a297-15769ba3277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afd5ed8-13b8-49ae-99de-e232540a893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:05 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Volume volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 (6d23d7d0-58ab-471b-8378-0267f9d3fa60): created successfully Sep 28 17:05:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afd5ed8-13b8-49ae-99de-e232540a893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Flow 'volume_create_manager' (ac81f4f2-374f-4458-a57b-7686dee1bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-79ac9309-7a19-4a3a-9cdf-f76474583aaf tempest-AttachVolumeTestJSON-1710320888 None] Created volume successfully. Sep 28 17:05:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5b69ce19-91e8-463a-9c81-a18d4cfca186 req-22fd60cc-396b-431e-b87d-cad1075c4722 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5b69ce19-91e8-463a-9c81-a18d4cfca186 req-22fd60cc-396b-431e-b87d-cad1075c4722 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5b69ce19-91e8-463a-9c81-a18d4cfca186 req-22fd60cc-396b-431e-b87d-cad1075c4722 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-5b69ce19-91e8-463a-9c81-a18d4cfca186 req-22fd60cc-396b-431e-b87d-cad1075c4722 tempest-AttachVolumeTestJSON-1710320888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a80a4f22-4fab-4ab4-ada3-31c1da39e5f6', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:05:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-5b69ce19-91e8-463a-9c81-a18d4cfca186 req-22fd60cc-396b-431e-b87d-cad1075c4722 tempest-AttachVolumeTestJSON-1710320888 None] attachment_update completed successfully. Sep 28 17:05:11 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-9506081d-3e15-4c32-925b-e30b2d1e77bc req-af546fa6-79d2-490c-8056-47773ca23ef7 tempest-AttachVolumeTestJSON-1710320888 None] Terminate volume connection completed successfully. Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-9506081d-3e15-4c32-925b-e30b2d1e77bc req-af546fa6-79d2-490c-8056-47773ca23ef7 tempest-AttachVolumeTestJSON-1710320888 None] Deleting attachment 83454d83-b597-4a3c-a575-54c2cfd91f40. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Flow 'volume_create_manager' (f2b86f17-a169-4424-9296-f33d7fb38a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0241b1-63ac-4c47-b8a7-26d86f64284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0241b1-63ac-4c47-b8a7-26d86f64284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-969328338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cdfd55-029c-4d25-9f7a-c6bec1ce6170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83fedd5c680c4b19b50bee805750bc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:11Z,use_quota=True,user_id='2db7c1cf43874e29b4ca7f0a8eb74725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d92cea-ec86-40b9-a096-3196e9769bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d92cea-ec86-40b9-a096-3196e9769bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470087f3-5dec-4ee6-a8e1-5678fa259983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470087f3-5dec-4ee6-a8e1-5678fa259983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38cdfd55-029c-4d25-9f7a-c6bec1ce6170', 'volume_name': 'volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acae4c3-d545-419b-b2be-f6f46725ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acae4c3-d545-419b-b2be-f6f46725ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8b08fb-e72b-4666-b915-9ee2458d9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:11 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170', 'volume_size': 1} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-969328338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cdfd55-029c-4d25-9f7a-c6bec1ce6170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83fedd5c680c4b19b50bee805750bc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:11Z,use_quota=True,user_id='2db7c1cf43874e29b4ca7f0a8eb74725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Creating volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:11 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:05:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:11 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 1073741824 Sep 28 17:05:11 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:12 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 1073741824" returned: 0 in 0.653s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:12 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 Sep 28 17:05:12 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:12 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" returned: 0 in 0.277s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8b08fb-e72b-4666-b915-9ee2458d9418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f555f-97db-4082-a987-638a9d9011cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:12 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Volume volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 (38cdfd55-029c-4d25-9f7a-c6bec1ce6170): created successfully Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f555f-97db-4082-a987-638a9d9011cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Flow 'volume_create_manager' (f2b86f17-a169-4424-9296-f33d7fb38a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-669a0559-c173-4a1e-8e34-8a8941aa6553 tempest-SnapshotsActionsTest-189336491 None] Created volume successfully. Sep 28 17:05:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-e0665feb-8571-4bcb-9e95-3903bc578c96 req-c911b9ab-a599-425b-8a34-101c01f39555 tempest-AttachVolumeTestJSON-1710320888 None] Terminate volume connection completed successfully. Sep 28 17:05:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-e0665feb-8571-4bcb-9e95-3903bc578c96 req-c911b9ab-a599-425b-8a34-101c01f39555 tempest-AttachVolumeTestJSON-1710320888 None] Deleting attachment a80a4f22-4fab-4ab4-ada3-31c1da39e5f6. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Creating offline snapshot 224fd171-0bf6-4f87-a715-47b83ae5f2a3 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f66e6-0fb7-465b-82e9-9b28db667346]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:14 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 Sep 28 17:05:14 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:14 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" returned: 0 in 0.596s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:14 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 1G Sep 28 17:05:14 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:15 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 1G" returned: 0 in 0.793s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:15 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:15 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:15 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.384s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:15 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 is being set with open permissions: ugo+rw Sep 28 17:05:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:15 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:15 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:16 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.525s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:16 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info Sep 28 17:05:16 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:16 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info" returned: 0 in 0.365s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:16 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info is being set with open permissions: ugo+rw Sep 28 17:05:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:16 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info Sep 28 17:05:16 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:17 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.info" returned: 0 in 0.511s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e7e057a0-d924-4a2b-9117-0365c37b4598 tempest-SnapshotsActionsTest-189336491 None] Create snapshot completed successfully Sep 28 17:05:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-e9ac9aa0-dfa1-4c1f-9291-5d717e3903c5 req-0beef0ac-8775-4315-8127-1d9e325ece8f tempest-ServerActionsTestOtherA-782554590 None] Terminate volume connection completed successfully. Sep 28 17:05:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-e9ac9aa0-dfa1-4c1f-9291-5d717e3903c5 req-0beef0ac-8775-4315-8127-1d9e325ece8f tempest-ServerActionsTestOtherA-782554590 None] Deleting attachment 1caaee65-66b6-4334-b916-3e3f5d7652f2. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Creating offline snapshot d96f3315-d932-4ea2-bdc9-4f49f686daa0 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6ffe77-9c3c-492a-8901-1462e1ced143]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:19 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:19 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:20 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.568s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:20 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 1G Sep 28 17:05:20 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:20 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 1G" returned: 0 in 0.676s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:20 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 Sep 28 17:05:20 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-6d23d7d0-58ab-471b-8378-0267f9d3fa60-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-6d23d7d0-58ab-471b-8378-0267f9d3fa60-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-quobyte-6d23d7d0-58ab-471b-8378-0267f9d3fa60" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-6d23d7d0-58ab-471b-8378-0267f9d3fa60" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a3c6bf-2dd7-4c3b-aa1d-fa2887315d61]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:21 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 Sep 28 17:05:21 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:21 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0" returned: 0 in 0.592s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 is being set with open permissions: ugo+rw Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:21 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 Sep 28 17:05:21 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:21 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0" returned: 0 in 0.370s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-fe122b85-6c3a-4b62-86d8-ce065bf37974 tempest-SnapshotsActionsTest-189336491 None] Create snapshot completed successfully Sep 28 17:05:22 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60" returned: 0 in 0.825s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:22 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60 Sep 28 17:05:22 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:22 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d23d7d0-58ab-471b-8378-0267f9d3fa60" returned: 0 in 0.375s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-6d23d7d0-58ab-471b-8378-0267f9d3fa60" released by "delete_volume" :: held 1.282s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Created reservations ['90f32641-f839-471f-8473-2d0c9a9876fb', 'b2ff3fb7-68ce-4e61-8b75-982f7d1e7654', '1ece891c-c153-4154-8308-44ef42b7bf40', 'ae5e2009-bcc4-4f40-9311-1c469e0d9480'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:22 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:05:22 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-d96f3315-d932-4ea2-bdc9-4f49f686daa0-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-d96f3315-d932-4ea2-bdc9-4f49f686daa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:22 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-d96f3315-d932-4ea2-bdc9-4f49f686daa0" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Deleted volume successfully. Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-d96f3315-d932-4ea2-bdc9-4f49f686daa0" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Deleting offline snapshot d96f3315-d932-4ea2-bdc9-4f49f686daa0 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] snapshot_file for this snap is: volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4c63c43-9003-4e65-b865-30e82614602f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-6d23d7d0-58ab-471b-8378-0267f9d3fa60-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2143b-5ee8-41a4-8213-999d410a3078]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:23 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 Sep 28 17:05:23 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-973fd0e7-4079-4b87-bed9-448ae797402e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-973fd0e7-4079-4b87-bed9-448ae797402e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-quobyte-973fd0e7-4079-4b87-bed9-448ae797402e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-973fd0e7-4079-4b87-bed9-448ae797402e" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[520bb8fc-e931-43f9-90d0-21e70a75ae58]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:23 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0" returned: 0 in 0.537s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1dff9a-cf08-435e-90b6-79af4139d78e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:23 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e Sep 28 17:05:23 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:23 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:23 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:24 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e" returned: 0 in 0.718s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:24 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.582s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:24 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e Sep 28 17:05:24 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:24 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 Sep 28 17:05:24 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:24 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-973fd0e7-4079-4b87-bed9-448ae797402e" returned: 0 in 0.357s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-973fd0e7-4079-4b87-bed9-448ae797402e" released by "delete_volume" :: held 1.161s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Created reservations ['ce0d176e-afe2-4f71-b9a6-3bc559c39d6d', 'c7363330-51ef-4618-b7cb-c42ebc43c865', '78d25db6-01df-4280-86c1-da8ff7f326ae', 'abc625c0-82d5-4fbf-b7ce-bda5de3fcaab'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:25 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:05:25 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:25 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0" returned: 0 in 0.725s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:25 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0 Sep 28 17:05:25 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:25 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Deleted volume successfully. Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cacb929b-15a0-4e50-82d5-8296d1878d32 tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-973fd0e7-4079-4b87-bed9-448ae797402e-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:25 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.d96f3315-d932-4ea2-bdc9-4f49f686daa0" returned: 0 in 0.341s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-d96f3315-d932-4ea2-bdc9-4f49f686daa0" released by "_delete_snapshot" :: held 2.377s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_snapshot" :: held 2.437s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:25 devstack cinder-volume[87034]: WARNING cinder.quota [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Created reservations ['38ef85ed-8221-4341-a0d0-1af54911cf6a', '82eb95d9-b4fb-4d4e-b9ed-6e5ed53610e3', 'ae211b49-f079-4f5b-9312-b3c3d70300eb', 'ad94671d-c02d-4280-881e-fec5628aae21'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Delete snapshot completed successfully. Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f01e9d5-e10a-41b8-9daf-31a2fd8f2cee tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-d96f3315-d932-4ea2-bdc9-4f49f686daa0-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-e1d35d29-b68a-4881-bf36-89e5b93b8d85-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-e1d35d29-b68a-4881-bf36-89e5b93b8d85-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "cinder-quobyte-e1d35d29-b68a-4881-bf36-89e5b93b8d85" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-e1d35d29-b68a-4881-bf36-89e5b93b8d85" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22c294-0dd3-406b-ad23-723ef9dd3be6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:26 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 Sep 28 17:05:26 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:26 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85" returned: 0 in 0.664s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:26 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85 Sep 28 17:05:26 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Creating offline snapshot fa6b9c95-25a9-4410-b2fd-8f38b0f66987 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d5b058-8235-4eb3-8ccc-28c3179980e7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Flow 'volume_create_manager' (9de1f552-9f39-4ab9-abbf-53c66ecff45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8667a4-0f76-407f-ad3f-e084fc0e5db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:27 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:27 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8667a4-0f76-407f-ad3f-e084fc0e5db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1103418182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11daaed-537d-424c-b94b-06bd263921c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0629ac39fb4d34b9f9abbcf38a1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:27Z,use_quota=True,user_id='9675e5cfbb6542c080ae0733ae8a50b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc998f76-4ca4-48bf-bdd1-db539576445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:27 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc998f76-4ca4-48bf-bdd1-db539576445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f6da78-011e-4c58-8be8-1b94e109ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e1d35d29-b68a-4881-bf36-89e5b93b8d85" returned: 0 in 0.454s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-quobyte-e1d35d29-b68a-4881-bf36-89e5b93b8d85" released by "delete_volume" :: held 1.191s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Created reservations ['026e278b-036e-442f-bbe6-70945fde34ba', 'b4e58cdc-944d-4f1c-842b-a79ac129b507', 'e0522c7c-7958-46a6-ad66-5e362e5afe00', 'fd0430de-854f-4ebe-83c7-76c585a959e9'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:27 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:05:27 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:27 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.739s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:27 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 1G Sep 28 17:05:27 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:27 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:27 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Deleted volume successfully. Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-25dbcf73-1c6e-40a0-a065-5d74249a824f tempest-AttachVolumeTestJSON-1710320888 None] Lock "cinder-e1d35d29-b68a-4881-bf36-89e5b93b8d85-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f6da78-011e-4c58-8be8-1b94e109ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e11daaed-537d-424c-b94b-06bd263921c9', 'volume_name': 'volume-e11daaed-537d-424c-b94b-06bd263921c9', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436f0498-59c8-4f44-b81e-98c57e59f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436f0498-59c8-4f44-b81e-98c57e59f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbf69c-b8e3-49f0-8023-a6600b819a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Volume e11daaed-537d-424c-b94b-06bd263921c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e11daaed-537d-424c-b94b-06bd263921c9', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Trying to clone e11daaed-537d-424c-b94b-06bd263921c9 from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:05:28 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:05:28 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 1G" returned: 0 in 0.894s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:28 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 Sep 28 17:05:28 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71873cc-c43d-4671-9f2d-a2da32eb92b8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:28 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD Sep 28 17:05:28 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987" returned: 0 in 0.411s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:28 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 is being set with open permissions: ugo+rw Sep 28 17:05:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:29 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 Sep 28 17:05:29 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:29 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef is fetched for user 9675e5cfbb6542c080ae0733ae8a50b4. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743149f-20be-4076-8be1-9cfab0a63a7e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:29 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987" returned: 0 in 0.321s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:29 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD Sep 28 17:05:29 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:29 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7960b9dd-bb4b-4fd3-b7b9-1d25a625e557 tempest-SnapshotsActionsTest-189336491 None] Create snapshot completed successfully Sep 28 17:05:29 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1103418182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11daaed-537d-424c-b94b-06bd263921c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0629ac39fb4d34b9f9abbcf38a1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:27Z,use_quota=True,user_id='9675e5cfbb6542c080ae0733ae8a50b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Creating volume e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:29 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:05:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:29 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1073741824 Sep 28 17:05:29 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-fa6b9c95-25a9-4410-b2fd-8f38b0f66987-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-fa6b9c95-25a9-4410-b2fd-8f38b0f66987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-fa6b9c95-25a9-4410-b2fd-8f38b0f66987" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-fa6b9c95-25a9-4410-b2fd-8f38b0f66987" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Deleting offline snapshot fa6b9c95-25a9-4410-b2fd-8f38b0f66987 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] snapshot_file for this snap is: volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41c4ea-af55-4cde-b839-82ed135777a0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1073741824" returned: 0 in 0.692s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 Sep 28 17:05:30 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 Sep 28 17:05:30 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:30 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987" returned: 0 in 0.536s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:30 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9" returned: 0 in 0.417s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab376ee0-2569-4501-94d8-c3b83f3448e7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Attempting download of 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume e11daaed-537d-424c-b94b-06bd263921c9. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5498c-4dcf-4f21-958a-ffa95f3cd28f]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:31 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e Sep 28 17:05:31 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e" returned: 0 in 0.496s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.627s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:31 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 Sep 28 17:05:31 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e Sep 28 17:05:31 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:31 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e" returned: 1 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_0matm76e' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b10865-d869-46f2-9f61-b7ed64f7b76a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:32 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987" returned: 0 in 0.606s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:32 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987 Sep 28 17:05:32 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:32 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD Sep 28 17:05:32 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:32 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.fa6b9c95-25a9-4410-b2fd-8f38b0f66987" returned: 0 in 0.346s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-fa6b9c95-25a9-4410-b2fd-8f38b0f66987" released by "_delete_snapshot" :: held 2.301s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_snapshot" :: held 2.334s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:32 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:32 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 Sep 28 17:05:32 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Created reservations ['36bf46de-7fd2-469d-846d-407cfbf7c6cd', 'c92d1268-2f5e-4882-b1fc-71c427187031', '9f1c27b9-da99-4759-beb9-467c5c48eb1c', '6738d14c-2f66-4c01-a3c5-f188f75adca1'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Delete snapshot completed successfully. Sep 28 17:05:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3163d5ab-12a4-433c-a26f-e2926a0c9fc8 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-fa6b9c95-25a9-4410-b2fd-8f38b0f66987-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Creating offline snapshot ffad696a-bd50-469a-8eae-14e0feb2aeb9 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[34996166-68f0-4432-b7d1-955e8006c847]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:34 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:34 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:34 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.550s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:34 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 1G Sep 28 17:05:34 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:35 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 1G" returned: 0 in 0.833s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:35 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 Sep 28 17:05:35 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:35 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9" returned: 0 in 3.242s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:35 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_rdrfhinudevstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:05:35 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Converted 112.00 MB image at 34.53 MB/s Sep 28 17:05:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:35 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1G Sep 28 17:05:35 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:36 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9" returned: 0 in 0.597s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:36 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 is being set with open permissions: ugo+rw Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:36 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 Sep 28 17:05:36 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:36 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 1G" returned: 0 in 0.521s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Downloaded image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume e11daaed-537d-424c-b94b-06bd263921c9 successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef for user 9675e5cfbb6542c080ae0733ae8a50b4 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Marking volume e11daaed-537d-424c-b94b-06bd263921c9 as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Copying metadata from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef to e11daaed-537d-424c-b94b-06bd263921c9. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Creating volume glance metadata for volume e11daaed-537d-424c-b94b-06bd263921c9 backed by image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:05:36 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9" returned: 0 in 0.333s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-69abeea4-973b-438d-8b16-734b93f04ba0 tempest-SnapshotsActionsTest-189336491 None] Create snapshot completed successfully Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbf69c-b8e3-49f0-8023-a6600b819a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11daaed-537d-424c-b94b-06bd263921c9', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24919d1-d1ed-49cb-bf9f-4b177efbd7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Volume volume-e11daaed-537d-424c-b94b-06bd263921c9 (e11daaed-537d-424c-b94b-06bd263921c9): created successfully Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24919d1-d1ed-49cb-bf9f-4b177efbd7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Flow 'volume_create_manager' (9de1f552-9f39-4ab9-abbf-53c66ecff45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6c1fc1ca-a08a-4211-abe2-55d26c2ba976 tempest-ServerActionsTestOtherA-782554590 None] Created volume successfully. Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-ffad696a-bd50-469a-8eae-14e0feb2aeb9-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-ffad696a-bd50-469a-8eae-14e0feb2aeb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-ffad696a-bd50-469a-8eae-14e0feb2aeb9" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-ffad696a-bd50-469a-8eae-14e0feb2aeb9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Deleting offline snapshot ffad696a-bd50-469a-8eae-14e0feb2aeb9 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] snapshot_file for this snap is: volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf17cd-3617-4778-a59d-708d3676e200]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:37 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 Sep 28 17:05:37 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9" returned: 0 in 0.599s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[877937df-cda5-4254-8d1d-4f6e18aabded]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:38 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:38 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.600s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:38 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 Sep 28 17:05:38 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:39 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9" returned: 0 in 0.622s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:39 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9 Sep 28 17:05:39 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:39 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.ffad696a-bd50-469a-8eae-14e0feb2aeb9" returned: 0 in 0.481s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-ffad696a-bd50-469a-8eae-14e0feb2aeb9" released by "_delete_snapshot" :: held 2.485s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_snapshot" :: held 2.523s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Created reservations ['800e5396-0bf4-43c5-b68e-77f749e681c9', 'ce844789-beae-4ea5-8eaf-03de5046badb', 'ef8e4702-8c2b-4f1d-ab0c-3087b40f2e74', '388d687b-e9b2-4628-9dbf-42bbb89bd39b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Delete snapshot completed successfully. Sep 28 17:05:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4547f836-6ed4-40ea-8346-3b906637aef0 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-ffad696a-bd50-469a-8eae-14e0feb2aeb9-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Creating offline snapshot e39352e8-40c2-4c07-89b0-e407759eb1ef of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0190947a-957f-4a3d-82fe-e13a4a59c62f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:41 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:41 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-febba2bb-f6dd-4ef4-b703-77f6253c22dd req-cb9ffc84-aec3-49e5-acd1-aeb03c5d78ba tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:42 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.937s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:42 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef 1G Sep 28 17:05:42 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:43 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef 1G" returned: 0 in 0.716s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:43 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef Sep 28 17:05:43 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Flow 'volume_create_manager' (322fae54-2f4c-4352-9d80-bc5900d9849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a04344-1c3b-4c75-9af9-bdfcef0dc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a04344-1c3b-4c75-9af9-bdfcef0dc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1632708322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41046ed-e3df-41eb-8463-6388ef8c4525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd91abeb561f4c418b7c86f0970209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:43Z,use_quota=True,user_id='6c2bbaee0ed54ede8acf7ea5b6b1c47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb68178-9c23-4b43-b356-f6c3f5b9bc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb68178-9c23-4b43-b356-f6c3f5b9bc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d9acac-8df8-4620-ba91-83cfc79443f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d9acac-8df8-4620-ba91-83cfc79443f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41046ed-e3df-41eb-8463-6388ef8c4525', 'volume_name': 'volume-a41046ed-e3df-41eb-8463-6388ef8c4525', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2736345-6b90-4812-b2ad-1adc26e066c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2736345-6b90-4812-b2ad-1adc26e066c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ea0bf-66eb-4e78-95e0-1753021f2962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Volume a41046ed-e3df-41eb-8463-6388ef8c4525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41046ed-e3df-41eb-8463-6388ef8c4525', 'volume_size': 1} Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:43 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef" returned: 0 in 0.476s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:43 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef is being set with open permissions: ugo+rw Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:43 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef Sep 28 17:05:43 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:43 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef" returned: 0 in 0.303s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-febba2bb-f6dd-4ef4-b703-77f6253c22dd req-cb9ffc84-aec3-49e5-acd1-aeb03c5d78ba tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-febba2bb-f6dd-4ef4-b703-77f6253c22dd req-cb9ffc84-aec3-49e5-acd1-aeb03c5d78ba tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1632708322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41046ed-e3df-41eb-8463-6388ef8c4525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd91abeb561f4c418b7c86f0970209e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:43Z,use_quota=True,user_id='6c2bbaee0ed54ede8acf7ea5b6b1c47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Creating volume a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:44 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:44 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 1073741824 Sep 28 17:05:44 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-453f3ec3-c0be-4b22-8e7b-898bd81bb6df tempest-SnapshotsActionsTest-189336491 None] Create snapshot completed successfully Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-febba2bb-f6dd-4ef4-b703-77f6253c22dd req-cb9ffc84-aec3-49e5-acd1-aeb03c5d78ba tempest-ServerActionsTestOtherA-782554590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-e11daaed-537d-424c-b94b-06bd263921c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b34876c-4a47-472c-8e34-dfe0ef9d5171', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:05:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-febba2bb-f6dd-4ef4-b703-77f6253c22dd req-cb9ffc84-aec3-49e5-acd1-aeb03c5d78ba tempest-ServerActionsTestOtherA-782554590 None] attachment_update completed successfully. Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-e39352e8-40c2-4c07-89b0-e407759eb1ef-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-e39352e8-40c2-4c07-89b0-e407759eb1ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Acquiring lock "cinder-quobyte-e39352e8-40c2-4c07-89b0-e407759eb1ef" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-e39352e8-40c2-4c07-89b0-e407759eb1ef" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Deleting offline snapshot e39352e8-40c2-4c07-89b0-e407759eb1ef of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] snapshot_file for this snap is: volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:44 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9742c6-f40d-4ec8-ae90-bcd5ca74c759]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 1073741824" returned: 0 in 0.867s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:45 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 Sep 28 17:05:45 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:45 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef Sep 28 17:05:45 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:45 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525" returned: 0 in 0.351s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ea0bf-66eb-4e78-95e0-1753021f2962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41046ed-e3df-41eb-8463-6388ef8c4525', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f218fc56-892f-4291-9cf6-734f2e5476c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Volume volume-a41046ed-e3df-41eb-8463-6388ef8c4525 (a41046ed-e3df-41eb-8463-6388ef8c4525): created successfully Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f218fc56-892f-4291-9cf6-734f2e5476c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Flow 'volume_create_manager' (322fae54-2f4c-4352-9d80-bc5900d9849b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-57c068c9-7bb3-495a-b40e-89377339ddc6 req-28d98883-4581-494a-94da-154cc6c6cb38 tempest-VolumesSnapshotsTestJSON-1362963917 None] Created volume successfully. Sep 28 17:05:45 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef" returned: 0 in 0.671s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f7dfb5-626e-43ef-8708-047c62a96ff9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:45 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:45 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:46 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 1.076s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:46 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef Sep 28 17:05:46 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Creating offline snapshot 202c6470-8b7e-4e39-98de-99fff929f584 of volume a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:05:47 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a674319-6961-4abc-88db-fb5d4c96ce73]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:47 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef" returned: 0 in 0.751s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:47 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef Sep 28 17:05:47 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:47 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 Sep 28 17:05:47 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:48 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.e39352e8-40c2-4c07-89b0-e407759eb1ef" returned: 0 in 0.741s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-e39352e8-40c2-4c07-89b0-e407759eb1ef" released by "_delete_snapshot" :: held 3.462s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_snapshot" :: held 3.530s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:48 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525" returned: 0 in 1.129s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:48 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 1G Sep 28 17:05:48 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Created reservations ['d5781b5d-58b3-4102-9858-e0fcc373f22f', 'c311b0bf-5050-4314-af35-8fb830425549', 'd040b954-9e2e-4b4d-9f8e-f5f82592ffd3', '7a40efac-102c-4448-ac9f-5f2ad5bb6a2f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Delete snapshot completed successfully. Sep 28 17:05:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac3b223c-6340-4e7e-ae2b-45697b6f5b63 tempest-SnapshotsActionsTest-642251581 None] Lock "cinder-e39352e8-40c2-4c07-89b0-e407759eb1ef-delete_snapshot" released by "delete_snapshot" :: held 3.875s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:49 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 1G" returned: 0 in 0.780s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41046ed-e3df-41eb-8463-6388ef8c4525 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:49 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41046ed-e3df-41eb-8463-6388ef8c4525 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 Sep 28 17:05:49 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:49 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41046ed-e3df-41eb-8463-6388ef8c4525 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584" returned: 0 in 0.599s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:49 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 is being set with open permissions: ugo+rw Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:49 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 Sep 28 17:05:49 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "cinder-224fd171-0bf6-4f87-a715-47b83ae5f2a3-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-224fd171-0bf6-4f87-a715-47b83ae5f2a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "cinder-quobyte-224fd171-0bf6-4f87-a715-47b83ae5f2a3" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-224fd171-0bf6-4f87-a715-47b83ae5f2a3" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Deleting offline snapshot 224fd171-0bf6-4f87-a715-47b83ae5f2a3 of volume 38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] snapshot_file for this snap is: volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfcd746-3e8a-4f1f-8bc5-f6b35434b111]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:50 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584" returned: 0 in 0.493s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=87,cinder:UPDATE=72,cinder:INSERT=36,cinder:DELETE=9 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=100,cinder:UPDATE=90,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:50 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info Sep 28 17:05:50 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:50 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:50 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:50 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info" returned: 0 in 0.423s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:50 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info is being set with open permissions: ugo+rw Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:50 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info Sep 28 17:05:50 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:50 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.712s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[640a3597-5ebd-4ead-9c1f-b51cddcb3fb4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:51 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 Sep 28 17:05:51 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:51 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.info" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.432s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-416c9c53-5d41-4726-bfe0-75a76d804216 req-5296670f-aee0-4413-94d3-3773906600b3 tempest-VolumesSnapshotsTestJSON-1362963917 None] Create snapshot completed successfully Sep 28 17:05:51 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" returned: 0 in 0.851s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:51 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:51 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "cinder-202c6470-8b7e-4e39-98de-99fff929f584-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-202c6470-8b7e-4e39-98de-99fff929f584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "cinder-quobyte-202c6470-8b7e-4e39-98de-99fff929f584" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-202c6470-8b7e-4e39-98de-99fff929f584" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Deleting offline snapshot 202c6470-8b7e-4e39-98de-99fff929f584 of volume a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] snapshot_file for this snap is: volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e475cc-914b-42ab-b6ae-b1ada7f1dd0d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:52 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 1.063s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:52 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3 Sep 28 17:05:52 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:53 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 Sep 28 17:05:53 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:53 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170.224fd171-0bf6-4f87-a715-47b83ae5f2a3" returned: 0 in 0.596s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-224fd171-0bf6-4f87-a715-47b83ae5f2a3" released by "_delete_snapshot" :: held 3.564s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_snapshot" :: held 3.624s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:53 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584" returned: 0 in 0.873s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41046ed-e3df-41eb-8463-6388ef8c4525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4251121-2bc3-4d06-b17e-b51db89177ad]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Created reservations ['95cae377-0218-4436-98d2-ac184fd52609', 'c49843a7-dca0-4728-9204-a33ce9e48f44', 'a80d842e-f192-4580-963d-b69cbf797555', '7a1109ee-460b-47d2-87c2-ad043a4bfe2b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:54 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 Sep 28 17:05:54 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Delete snapshot completed successfully. Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3c71d352-85b9-4f5e-8673-a3ed319215b0 tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-224fd171-0bf6-4f87-a715-47b83ae5f2a3-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "cinder-38cdfd55-029c-4d25-9f7a-c6bec1ce6170-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:54 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525" returned: 0 in 0.797s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-38cdfd55-029c-4d25-9f7a-c6bec1ce6170-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:54 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 Sep 28 17:05:54 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" acquired by "delete_volume" :: waited 0.043s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7f5f4-3408-4638-ae70-5099fd900d28]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:55 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 Sep 28 17:05:55 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:55 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584" returned: 0 in 1.054s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:55 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584 Sep 28 17:05:55 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:56 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" returned: 0 in 1.141s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:56 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170 Sep 28 17:05:56 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:56 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525.202c6470-8b7e-4e39-98de-99fff929f584" returned: 0 in 0.670s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-202c6470-8b7e-4e39-98de-99fff929f584" released by "_delete_snapshot" :: held 3.718s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" released by "delete_snapshot" :: held 3.823s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG cinder.quota [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Created reservations ['0061ea4b-370a-4d94-b601-b4a3f38d7043', 'f28c7858-4b62-4eed-b231-bb688c6c7081', 'c772aa7f-1bb5-4e7d-8eb6-25e5b266654b', 'e2dd4b53-2b01-42d5-926a-9ab401e9aed5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:56 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" returned: 0 in 0.843s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-quobyte-38cdfd55-029c-4d25-9f7a-c6bec1ce6170" released by "delete_volume" :: held 2.180s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Delete snapshot completed successfully. Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-a3f94b60-e66a-46bc-8f49-720a8126fa41 req-792895ad-7cc5-48a5-8f59-6c6929aeee3b tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-202c6470-8b7e-4e39-98de-99fff929f584-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Created reservations ['44e1c916-879f-43bf-86b2-0c5e69a77753', '606e0a2c-6bb0-4251-be52-0414296abd5a', 'e0bd17e7-c23f-4f7c-af69-075b882e98ba', '1fe01682-76dc-4802-a01e-7cc25fedf18a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:57 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:05:57 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "cinder-a41046ed-e3df-41eb-8463-6388ef8c4525-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-a41046ed-e3df-41eb-8463-6388ef8c4525-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 1.038s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Deleted volume successfully. Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2db93d5b-8dbe-4c3b-ab5a-ee02b7b0e82e tempest-SnapshotsActionsTest-189336491 None] Lock "cinder-38cdfd55-029c-4d25-9f7a-c6bec1ce6170-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" acquired by "delete_volume" :: waited 0.077s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61aea75-0c7e-488c-a1a5-9fb7d0190471]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:59 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 Sep 28 17:05:59 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:59 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525" returned: 0 in 1.143s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:00 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525 Sep 28 17:06:00 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:00 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a41046ed-e3df-41eb-8463-6388ef8c4525" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-quobyte-a41046ed-e3df-41eb-8463-6388ef8c4525" released by "delete_volume" :: held 1.837s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:00 devstack cinder-volume[87034]: DEBUG cinder.quota [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Created reservations ['c154121f-fe70-438a-9e7a-e365b2c2e351', '9762002a-58f9-476c-a264-a36d08294f86', '62354a2a-22f7-44bd-8d59-20ca30e7f4bf', '3cab313f-de17-4eda-bc18-2e04c0619a1b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:01 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:01 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.563s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG cinder.manager [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Deleted volume successfully. Sep 28 17:06:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-3cbc7fe2-ad9d-4c0c-bccc-8b704d8f54e2 req-32c254d2-9200-4288-badc-5eddac27985d tempest-VolumesSnapshotsTestJSON-1362963917 None] Lock "cinder-a41046ed-e3df-41eb-8463-6388ef8c4525-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:02 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:02 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:03 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.871s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:06:10 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:11 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:DELETE=2,cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=27 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-1bc0a107-10d4-4cd1-8e73-cfe1f7124411 tempest-ServerActionsTestOtherA-782554590 None] Terminate volume connection completed successfully. Sep 28 17:06:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-1bc0a107-10d4-4cd1-8e73-cfe1f7124411 tempest-ServerActionsTestOtherA-782554590 None] Deleting attachment 2b34876c-4a47-472c-8e34-dfe0ef9d5171. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:06:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-e9e60edc-07aa-4243-b392-835b076821b5 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-e9e60edc-07aa-4243-b392-835b076821b5 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-e9e60edc-07aa-4243-b392-835b076821b5 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-e9e60edc-07aa-4243-b392-835b076821b5 tempest-ServerActionsTestOtherA-782554590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-e11daaed-537d-424c-b94b-06bd263921c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9852c87-a970-4bf2-8bed-2b11ca1988b2', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-0fb5a47d-8f56-4993-b608-1ede8468fefd req-e9e60edc-07aa-4243-b392-835b076821b5 tempest-ServerActionsTestOtherA-782554590 None] attachment_update completed successfully. Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Flow 'volume_create_manager' (9c4930f1-d2de-423c-84c8-c53772feea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac57c30-f9ef-46cc-9ab1-b530e8e5efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac57c30-f9ef-46cc-9ab1-b530e8e5efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1039152350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfbf930-b76a-4743-a1d7-2608f4a81200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b4e308a634402791024a3e1ec0023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:26Z,use_quota=True,user_id='e405a4a204e1449189215204fc2b47da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abed971c-69eb-4687-b583-7f276d6bfd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abed971c-69eb-4687-b583-7f276d6bfd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0df224-534a-4a52-a663-f156e31afcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0df224-534a-4a52-a663-f156e31afcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfbf930-b76a-4743-a1d7-2608f4a81200', 'volume_name': 'volume-5bfbf930-b76a-4743-a1d7-2608f4a81200', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc8ba0a-ed0d-43b8-8d54-3e91cd305c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc8ba0a-ed0d-43b8-8d54-3e91cd305c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf862-829e-4b2d-9223-d862c3877a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Volume 5bfbf930-b76a-4743-a1d7-2608f4a81200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfbf930-b76a-4743-a1d7-2608f4a81200', 'volume_size': 1} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1039152350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfbf930-b76a-4743-a1d7-2608f4a81200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b4e308a634402791024a3e1ec0023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:26Z,use_quota=True,user_id='e405a4a204e1449189215204fc2b47da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Creating volume 5bfbf930-b76a-4743-a1d7-2608f4a81200 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:26 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:06:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:26 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 1073741824 Sep 28 17:06:26 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:27 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 1073741824" returned: 0 in 0.906s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:27 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 Sep 28 17:06:27 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:27 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200" returned: 0 in 0.362s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf862-829e-4b2d-9223-d862c3877a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfbf930-b76a-4743-a1d7-2608f4a81200', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6c1e4e-8f16-4682-bcfe-bd45a01e4da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Volume volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 (5bfbf930-b76a-4743-a1d7-2608f4a81200): created successfully Sep 28 17:06:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6c1e4e-8f16-4682-bcfe-bd45a01e4da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Flow 'volume_create_manager' (9c4930f1-d2de-423c-84c8-c53772feea77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8e410dc1-1819-4b7f-9ac7-c126c237ebdf tempest-ServersNegativeTestJSON-592507793 None] Created volume successfully. Sep 28 17:06:30 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Flow 'volume_create_manager' (ae340f69-6c6b-44a1-9c84-73c2a970666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e490b3d-972c-43b0-a5c0-68929451bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e490b3d-972c-43b0-a5c0-68929451bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1999438855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d8af57-95be-4978-9a75-f19371962ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b4e308a634402791024a3e1ec0023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:31Z,use_quota=True,user_id='e405a4a204e1449189215204fc2b47da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63e804a-3d17-4c1f-af8a-7b33fe0ee8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63e804a-3d17-4c1f-af8a-7b33fe0ee8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4713d604-d08e-42cd-89fa-d6c33c072dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4713d604-d08e-42cd-89fa-d6c33c072dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d8af57-95be-4978-9a75-f19371962ea7', 'volume_name': 'volume-c7d8af57-95be-4978-9a75-f19371962ea7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8f876-faeb-4890-8dd1-d933aef01462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8f876-faeb-4890-8dd1-d933aef01462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9d2025-2e8a-40d0-8b39-89666fd1af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Volume c7d8af57-95be-4978-9a75-f19371962ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d8af57-95be-4978-9a75-f19371962ea7', 'volume_size': 1} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1999438855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d8af57-95be-4978-9a75-f19371962ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b4e308a634402791024a3e1ec0023e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:31Z,use_quota=True,user_id='e405a4a204e1449189215204fc2b47da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Creating volume c7d8af57-95be-4978-9a75-f19371962ea7 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:31 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:31 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 1073741824 Sep 28 17:06:31 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 1073741824" returned: 0 in 0.782s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:32 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 Sep 28 17:06:32 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:32 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7" returned: 0 in 0.727s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9d2025-2e8a-40d0-8b39-89666fd1af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d8af57-95be-4978-9a75-f19371962ea7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01466fc5-f679-469b-b53b-06cb8d8f7ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Volume volume-c7d8af57-95be-4978-9a75-f19371962ea7 (c7d8af57-95be-4978-9a75-f19371962ea7): created successfully Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01466fc5-f679-469b-b53b-06cb8d8f7ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Flow 'volume_create_manager' (ae340f69-6c6b-44a1-9c84-73c2a970666d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9edecc49-0c7b-43e8-9260-13b4a9fc08f1 tempest-ServersNegativeTestJSON-592507793 None] Created volume successfully. Sep 28 17:06:33 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b229482f-d85a-4ff3-bae2-d383a02dcbef tempest-GroupsV314Test-1635727155 None] Group tempest-GroupsV314Test-Group-1717163184: creating Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Flow 'volume_create_manager' (5e354fd9-9435-4c3a-9c42-008bfd8958a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86111987-89c1-4bc0-8513-757d8b9a7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b229482f-d85a-4ff3-bae2-d383a02dcbef tempest-GroupsV314Test-1635727155 None] Group tempest-GroupsV314Test-Group-1717163184: created successfully Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86111987-89c1-4bc0-8513-757d8b9a7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1680202261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466a513d-d219-483c-80ab-5c13978a556a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c63eed05cca48ee87d80b839362293a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:34Z,use_quota=True,user_id='99140146bb7c42d6a0f5716a19d0c2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4711c4b4-a66e-4e9e-93af-ffc137e48857),volume_type_id=4711c4b4-a66e-4e9e-93af-ffc137e48857)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1a0a43-7ee9-4c51-a693-1fca1f82ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1a0a43-7ee9-4c51-a693-1fca1f82ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa07f823-f500-4f15-bc40-f9faaecad957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa07f823-f500-4f15-bc40-f9faaecad957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466a513d-d219-483c-80ab-5c13978a556a', 'volume_name': 'volume-466a513d-d219-483c-80ab-5c13978a556a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ee2c06-bf76-4d25-8295-7569212ad838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ee2c06-bf76-4d25-8295-7569212ad838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56ed54-8017-454c-8f4c-bc5bd12161f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Volume 466a513d-d219-483c-80ab-5c13978a556a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466a513d-d219-483c-80ab-5c13978a556a', 'volume_size': 1} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1680202261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466a513d-d219-483c-80ab-5c13978a556a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c63eed05cca48ee87d80b839362293a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:34Z,use_quota=True,user_id='99140146bb7c42d6a0f5716a19d0c2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4711c4b4-a66e-4e9e-93af-ffc137e48857),volume_type_id=4711c4b4-a66e-4e9e-93af-ffc137e48857)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Creating volume 466a513d-d219-483c-80ab-5c13978a556a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:33 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:06:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b229482f-d85a-4ff3-bae2-d383a02dcbef tempest-GroupsV314Test-1635727155 None] Create group completed successfully. Sep 28 17:06:34 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a 1073741824 Sep 28 17:06:34 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "cinder-c7d8af57-95be-4978-9a75-f19371962ea7-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-c7d8af57-95be-4978-9a75-f19371962ea7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "cinder-quobyte-c7d8af57-95be-4978-9a75-f19371962ea7" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-quobyte-c7d8af57-95be-4978-9a75-f19371962ea7" acquired by "delete_volume" :: waited 0.055s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ff51b-095f-4754-80cb-29aa5fbb340c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:34 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 Sep 28 17:06:34 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:35 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a 1073741824" returned: 0 in 1.246s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:35 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a Sep 28 17:06:35 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:35 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7" returned: 0 in 1.016s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:35 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7 Sep 28 17:06:35 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:35 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a" returned: 0 in 0.423s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56ed54-8017-454c-8f4c-bc5bd12161f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466a513d-d219-483c-80ab-5c13978a556a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25871192-dbc2-4b27-8960-0048fd080938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Volume volume-466a513d-d219-483c-80ab-5c13978a556a (466a513d-d219-483c-80ab-5c13978a556a): created successfully Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25871192-dbc2-4b27-8960-0048fd080938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Flow 'volume_create_manager' (5e354fd9-9435-4c3a-9c42-008bfd8958a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-aded6ac9-914f-4650-9512-7fbc3f093688 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Created volume successfully. Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:36 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Flow 'volume_create_manager' (f415bbcf-3394-4460-98bc-171e48ab2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1baf3a-aba7-4487-be94-11993b98b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c7d8af57-95be-4978-9a75-f19371962ea7" returned: 0 in 0.702s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1baf3a-aba7-4487-be94-11993b98b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370305731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76536c2c-2daa-49ff-a9fb-9d43c9bd00dd,host='devstack@QuobyteHD#QuobyteHD',id=83c7ea2f-841c-44d7-b7a0-b959127dec0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c6b3b42c374e9e8ee74e5052e6ad36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:36Z,use_quota=True,user_id='1fcc48e4ade54206b8bacf212af35589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03d8c000-da3b-4dce-949b-f23850d83a06),volume_type_id=03d8c000-da3b-4dce-949b-f23850d83a06)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7684a167-8b1f-48c2-a2fe-b2f1effba546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7684a167-8b1f-48c2-a2fe-b2f1effba546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bedff4-64c1-4f8b-9dbd-b84a7e45196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bedff4-64c1-4f8b-9dbd-b84a7e45196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c7ea2f-841c-44d7-b7a0-b959127dec0b', 'volume_name': 'volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e98fb9-25d6-4891-b41b-efca2c8af07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e98fb9-25d6-4891-b41b-efca2c8af07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fcda7f-98dd-45d9-90c7-56aca0590986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Volume 83c7ea2f-841c-44d7-b7a0-b959127dec0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b', 'volume_size': 1} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=76536c2c-2daa-49ff-a9fb-9d43c9bd00dd,created_at=2026-09-28T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370305731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=76536c2c-2daa-49ff-a9fb-9d43c9bd00dd,host='devstack@QuobyteHD#QuobyteHD',id=83c7ea2f-841c-44d7-b7a0-b959127dec0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c6b3b42c374e9e8ee74e5052e6ad36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:36Z,use_quota=True,user_id='1fcc48e4ade54206b8bacf212af35589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03d8c000-da3b-4dce-949b-f23850d83a06),volume_type_id=03d8c000-da3b-4dce-949b-f23850d83a06)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Creating volume 83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:36 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-quobyte-c7d8af57-95be-4978-9a75-f19371962ea7" released by "delete_volume" :: held 1.902s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:36 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b 1073741824 Sep 28 17:06:36 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Created reservations ['0dc4dc09-da66-43e8-a8d8-3db9217a3fc8', '1b705946-ffb7-4658-a2c3-66405118a23b', '7d1df84d-70db-4976-b96f-935f7b8e5d34', '9d9d8ab5-6433-45ee-9e77-09cf27d6c9d2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:36 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "cinder-5bfbf930-b76a-4743-a1d7-2608f4a81200-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-5bfbf930-b76a-4743-a1d7-2608f4a81200-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "cinder-quobyte-5bfbf930-b76a-4743-a1d7-2608f4a81200" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-quobyte-5bfbf930-b76a-4743-a1d7-2608f4a81200" acquired by "delete_volume" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3db089-4748-4813-b680-e03925d63901]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:37 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.557s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Deleted volume successfully. Sep 28 17:06:37 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b 1073741824" returned: 0 in 0.821s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:37 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 Sep 28 17:06:37 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-09a488ab-85a3-471d-bafa-0a08b1353b75 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-c7d8af57-95be-4978-9a75-f19371962ea7-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:37 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:06:37 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:37 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200" returned: 0 in 0.643s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:37 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:37 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200 Sep 28 17:06:37 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 0.462s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fcda7f-98dd-45d9-90c7-56aca0590986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be8e5e5-7702-4141-82fa-d5a138f07994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:37 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Volume volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b (83c7ea2f-841c-44d7-b7a0-b959127dec0b): created successfully Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be8e5e5-7702-4141-82fa-d5a138f07994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Flow 'volume_create_manager' (f415bbcf-3394-4460-98bc-171e48ab2560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-014bad20-f21f-474d-8907-6bfb3b117e90 tempest-GroupsV314Test-1635727155 None] Created volume successfully. Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:37 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:37 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:38 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5bfbf930-b76a-4743-a1d7-2608f4a81200" returned: 0 in 0.335s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-quobyte-5bfbf930-b76a-4743-a1d7-2608f4a81200" released by "delete_volume" :: held 1.079s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Created reservations ['c73faa32-9e0c-4864-8f40-9e8c6a4a98e4', '1984e151-6d0f-4990-b891-d0cebcf6885e', 'a7f4a65d-6be4-4f84-af90-0638a62d2be3', 'd1ca375a-1bfa-4f94-8e56-1f5f6607f8cb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:38 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:38 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.361s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:38 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9559b81b-a955-44ae-bfd8-c82f88ae48f9 tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Retype volume completed successfully. Sep 28 17:06:38 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.287s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Deleted volume successfully. Sep 28 17:06:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-73b2c151-a66f-4378-8a9e-2aa81a41cb84 tempest-ServersNegativeTestJSON-592507793 None] Lock "cinder-5bfbf930-b76a-4743-a1d7-2608f4a81200-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "cinder-466a513d-d219-483c-80ab-5c13978a556a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "cinder-466a513d-d219-483c-80ab-5c13978a556a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "cinder-quobyte-466a513d-d219-483c-80ab-5c13978a556a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "cinder-quobyte-466a513d-d219-483c-80ab-5c13978a556a" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9595822-6412-46d6-838f-1425d31286df]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:39 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a Sep 28 17:06:39 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:39 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Cloning volume 83c7ea2f-841c-44d7-b7a0-b959127dec0b to volume c726d8f0-9544-4a69-bb17-f534ffbf9b52 Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Creating offline snapshot 0cee5633-f77b-4728-b340-27610d8afb6d of volume 83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f20af5-a8c8-4ff0-91d8-b2e0a274c24a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:40 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:06:40 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:40 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a" returned: 0 in 0.909s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:40 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a Sep 28 17:06:40 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:40 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-466a513d-d219-483c-80ab-5c13978a556a" returned: 0 in 0.600s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "cinder-quobyte-466a513d-d219-483c-80ab-5c13978a556a" released by "delete_volume" :: held 1.582s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:40 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 1.015s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d 1G Sep 28 17:06:41 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:41 devstack cinder-volume[87034]: WARNING cinder.quota [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:41 devstack cinder-volume[87034]: WARNING cinder.quota [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Created reservations ['d7865d96-5e46-4577-ae4b-e835ea956b9a', '7bed19d8-b21d-4b04-906d-96f71a1951d1', 'd9f08378-3092-4f54-a0f1-fd6a55ee6363', '254b2fc0-d171-4fce-a0ee-747b6963306b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:06:41 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:41 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:41 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d 1G" returned: 0 in 0.893s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Deleted volume successfully. Sep 28 17:06:41 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:41 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0da90f78-18d2-4a80-98b0-06bc1b6cbc1b tempest-VolumeRetypeWithoutMigrationTest-940905957 None] Lock "cinder-466a513d-d219-483c-80ab-5c13978a556a-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:42 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.736s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:42 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:06:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:42 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:42 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:43 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.570s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:43 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info Sep 28 17:06:43 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:43 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info" returned: 0 in 0.371s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:43 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:43 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info Sep 28 17:06:43 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:43 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.info" returned: 0 in 0.297s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Acquiring lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] snapshot: 0cee5633-f77b-4728-b340-27610d8afb6d, volume: c726d8f0-9544-4a69-bb17-f534ffbf9b52, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13a894a-cc0d-420d-8410-71a9f2497d20]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:44 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:44 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:44 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.535s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f95f90-bce3-4cbe-a7d4-5ecd2d713916]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:44 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:06:44 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:45 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 0.591s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:06:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:06:45 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:06:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:45 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 Sep 28 17:06:45 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=46,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:53 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=44,cinder:UPDATE=50,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:55 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52" returned: 0 in 10.184s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b, size 1024.00 MB, duration 10.19 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:06:55 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Converted 1024.00 MB image at 100.54 MB/s Sep 28 17:06:55 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:55 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 Sep 28 17:06:55 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:55 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52" returned: 0 in 0.330s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" released by "_copy_volume_from_snapshot" :: held 11.771s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Acquiring lock "cinder-quobyte-0cee5633-f77b-4728-b340-27610d8afb6d" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-0cee5633-f77b-4728-b340-27610d8afb6d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Deleting offline snapshot 0cee5633-f77b-4728-b340-27610d8afb6d of volume 83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] snapshot_file for this snap is: volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db3fcd0-9aa6-4df3-97f1-272a9f27544d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:56 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:56 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.569s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[015551f5-1100-4d8a-943c-ee625c6e6947]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:06:56 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:57 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 0.845s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:57 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:57 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.627s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d Sep 28 17:06:57 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b.0cee5633-f77b-4728-b340-27610d8afb6d" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-0cee5633-f77b-4728-b340-27610d8afb6d" released by "_delete_snapshot" :: held 2.627s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.661s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-848a258e-59d1-4bca-a09e-6d11d71cbc0e tempest-GroupsV314Test-1635727155 None] Create group from source-group-76536c2c-2daa-49ff-a9fb-9d43c9bd00dd completed successfully. Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Flow 'volume_create_manager' (dd12ffe0-966c-4eda-bb20-9684faabc73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c5e3a5-27e2-4aae-a98b-75be88e49089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c5e3a5-27e2-4aae-a98b-75be88e49089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1306617332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c235c712f06445838cdb022eefbcd619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:01Z,use_quota=True,user_id='515c37b94e6d42cf89ae16198ea98493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c252b7e8-9584-456b-8beb-38df61991aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c252b7e8-9584-456b-8beb-38df61991aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae91f083-69f2-4c23-b468-aced4848bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae91f083-69f2-4c23-b468-aced4848bea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2', 'volume_name': 'volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f88ee-b354-4f9c-9fae-2295e95452e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f88ee-b354-4f9c-9fae-2295e95452e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10845d54-1bb6-4e3f-aafd-36ad06c87c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Volume 4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2', 'volume_size': 1} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1306617332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c235c712f06445838cdb022eefbcd619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:01Z,use_quota=True,user_id='515c37b94e6d42cf89ae16198ea98493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Creating volume 4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:00 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Acquiring lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:00 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 1073741824 Sep 28 17:07:00 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f8c43-dfb7-4577-906e-9f9ef14c63bf]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:01 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 Sep 28 17:07:01 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:01 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 1073741824" returned: 0 in 0.782s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:01 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52" returned: 0 in 0.706s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:01 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52 Sep 28 17:07:01 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:01 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 Sep 28 17:07:01 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:01 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c726d8f0-9544-4a69-bb17-f534ffbf9b52" returned: 0 in 0.333s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:01 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" returned: 0 in 0.323s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-c726d8f0-9544-4a69-bb17-f534ffbf9b52" released by "delete_volume" :: held 1.117s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10845d54-1bb6-4e3f-aafd-36ad06c87c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65a2539-2c59-4a4c-9b7f-025ee8572fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Volume volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 (4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2): created successfully Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65a2539-2c59-4a4c-9b7f-025ee8572fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Flow 'volume_create_manager' (dd12ffe0-966c-4eda-bb20-9684faabc73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-be6cfaef-7f4c-48b7-a166-234224a6fffc req-eedd2a0d-9ce0-444b-8e48-34c09eaba780 tempest-VolumesGetTestJSON-1621535881 None] Created volume successfully. Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Created reservations ['a3e1ed62-72b3-490d-a132-04233bcc16e7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:02 devstack cinder-volume[87034]: WARNING cinder.quota [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2138364468 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2138364468, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:02 devstack cinder-volume[87034]: WARNING cinder.quota [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2138364468 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2138364468, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Created reservations ['f235b050-b447-43b7-a420-3eb194ba23b1', '98beae62-149c-463f-a98c-905f8efe32d2', '1b14a19e-8269-4344-aca3-1c4eb1e38ba0', 'fc5393b9-3fa9-4816-a010-7a0e9664e6cb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:02 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:02 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:02 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.274s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d4acc32f-67e7-4f67-8d13-4ee810b9ff9a tempest-GroupsV314Test-1635727155 None] Delete group completed successfully. Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:02 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:02 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:02 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.328s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Acquiring lock "cinder-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "cinder-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Acquiring lock "cinder-quobyte-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "cinder-quobyte-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b57fca4-1986-4d07-aabb-1610622f9d23]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Acquiring lock "cinder-quobyte-83c7ea2f-841c-44d7-b7a0-b959127dec0b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-83c7ea2f-841c-44d7-b7a0-b959127dec0b" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a166dc70-1226-48ca-a04f-d764191c7766]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 Sep 28 17:07:03 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:03 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:07:03 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" returned: 0 in 0.481s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:04 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2 Sep 28 17:07:04 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 0.546s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:04 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b Sep 28 17:07:04 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" returned: 0 in 0.304s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "cinder-quobyte-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2" released by "delete_volume" :: held 0.859s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.quota [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Created reservations ['b39b6581-ac5a-4a7b-9e9c-8ea1e06428bb', '3d41327c-9bc3-4290-9313-758676537639', '11306b6b-910d-4a2f-a1f8-50260499c3b2', '7a785f1b-9144-41db-803e-bd0c53c7db93'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:04 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:04 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-83c7ea2f-841c-44d7-b7a0-b959127dec0b" returned: 0 in 0.406s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Lock "cinder-quobyte-83c7ea2f-841c-44d7-b7a0-b959127dec0b" released by "delete_volume" :: held 1.061s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Created reservations ['627b2886-ef0e-45e8-96df-d2c062e4c4fa'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:04 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Created reservations ['97757bdc-cee0-4b8b-90dd-067c776bce86', '3c8303d8-cf6b-434c-b0ba-e3d72061bc6c', '708f57c8-2120-4e7b-b67c-dbfe152bbef2', '2903a1e1-4073-4e5b-af49-2fa386cc3c78'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:05 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.486s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG cinder.manager [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Deleted volume successfully. Sep 28 17:07:05 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:05 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-53d17eee-3bc6-4754-8fa3-b2269db1d8e4 req-70c360de-65ae-4e42-b3a8-42fb92402232 tempest-VolumesGetTestJSON-1621535881 None] Lock "cinder-4aedea3c-6bf7-4c9e-ba97-296b7acbc6f2-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:05 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.375s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-fc4ec2ad-7df3-4bd6-9f72-7f299ef369e0 tempest-GroupsV314Test-1635727155 None] Delete group completed successfully. Sep 28 17:07:15 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=35,cinder:SELECT=24,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:15 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=36,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-a7df8472-d990-4e6b-9b3f-d5553e4db415 tempest-ServerActionsTestOtherA-782554590 None] Terminate volume connection completed successfully. Sep 28 17:07:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-a7df8472-d990-4e6b-9b3f-d5553e4db415 tempest-ServerActionsTestOtherA-782554590 None] Deleting attachment a9852c87-a970-4bf2-8bed-2b11ca1988b2. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "cinder-e11daaed-537d-424c-b94b-06bd263921c9-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-e11daaed-537d-424c-b94b-06bd263921c9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "cinder-quobyte-e11daaed-537d-424c-b94b-06bd263921c9" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-quobyte-e11daaed-537d-424c-b94b-06bd263921c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc096e22-b9fe-4f60-9caa-f1a144ae20e7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:18 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 Sep 28 17:07:18 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3306abd-d19e-4542-af06-1f1606623e90 tempest-BackendsCapabilitiesAdminTestsJSON-223598280 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87034) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:07:18 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9" returned: 0 in 0.703s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:18 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9 Sep 28 17:07:18 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b6d17a1e-d892-46c9-b474-7f86e31bc1eb tempest-BackendsCapabilitiesAdminTestsJSON-223598280 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87034) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "cinder-e0cdcc27-6a66-4e1b-8a09-851911f10c7e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-e0cdcc27-6a66-4e1b-8a09-851911f10c7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "cinder-quobyte-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-quobyte-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4595bd8f-ab5b-4ea5-beaa-917be5c861e6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:19 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e11daaed-537d-424c-b94b-06bd263921c9" returned: 0 in 0.676s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-quobyte-e11daaed-537d-424c-b94b-06bd263921c9" released by "delete_volume" :: held 1.461s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:19 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e Sep 28 17:07:19 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.quota [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Created reservations ['507a26af-ce22-4039-bfd5-45b26d1fedb0', '04b0affc-f0b3-4cdf-8d30-bdb5f80e2170', 'b84068e3-03dc-48a1-b89f-07004424cf3c', '302a7efd-5668-419f-899d-c5b652792d37'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:19 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:19 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" returned: 0 in 0.697s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e Sep 28 17:07:20 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.manager [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:20 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Deleted volume successfully. Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-4608c565-3c80-4c7f-b20f-fb2dca46890c req-8ef9fa83-e26b-466b-a6c0-02ecbe6648d7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-e11daaed-537d-424c-b94b-06bd263921c9-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:20 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" returned: 0 in 0.489s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-quobyte-e0cdcc27-6a66-4e1b-8a09-851911f10c7e" released by "delete_volume" :: held 1.280s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Created reservations ['3c5d5069-b045-4683-93d3-bc1bc6e895a6', 'a7d20b66-66aa-4fd5-9881-f8ac07901078', '6de63ae9-75ca-4d3e-bbe8-07bf6bbfaace', '37df563c-7048-4143-bcfc-fb5a5ea6390b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:07:20 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:21 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.386s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:21 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Deleted volume successfully. Sep 28 17:07:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-03a9aa74-56cb-4ec3-8ac5-af0c88c377a7 tempest-ServerActionsTestOtherA-782554590 None] Lock "cinder-e0cdcc27-6a66-4e1b-8a09-851911f10c7e-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:30 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:31 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-89c27b92-a03b-4a05-a74d-5c066fdecac3 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-701943023: creating Sep 28 17:07:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-89c27b92-a03b-4a05-a74d-5c066fdecac3 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-701943023: created successfully Sep 28 17:07:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-89c27b92-a03b-4a05-a74d-5c066fdecac3 tempest-GroupSnapshotsTest-1724518088 None] Create group completed successfully. Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (c29099c6-4e52-4f33-927f-e32e5e5dd797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9fa9a6-dfa6-43cf-bffc-a9ea55445b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9fa9a6-dfa6-43cf-bffc-a9ea55445b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296664846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46294408-b92c-473c-bb3b-da321daba70c,host='devstack@QuobyteHD#QuobyteHD',id=54b7f7f2-a8c1-4892-a37d-4e9d401dfde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:39Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fd8fc33-b306-4ff8-9434-053735c87740),volume_type_id=0fd8fc33-b306-4ff8-9434-053735c87740)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd7e32d-7490-4b01-a6fd-3004d46959cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd7e32d-7490-4b01-a6fd-3004d46959cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c00a9f-5455-4a44-921b-26fe9d407fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c00a9f-5455-4a44-921b-26fe9d407fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b7f7f2-a8c1-4892-a37d-4e9d401dfde3', 'volume_name': 'volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc82ac-003b-4e4b-8834-7023b9c83785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fc82ac-003b-4e4b-8834-7023b9c83785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2463680-676b-4dd1-ba99-2f0ba013a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Volume 54b7f7f2-a8c1-4892-a37d-4e9d401dfde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3', 'volume_size': 1} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46294408-b92c-473c-bb3b-da321daba70c,created_at=2026-09-28T15:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1296664846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46294408-b92c-473c-bb3b-da321daba70c,host='devstack@QuobyteHD#QuobyteHD',id=54b7f7f2-a8c1-4892-a37d-4e9d401dfde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:39Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fd8fc33-b306-4ff8-9434-053735c87740),volume_type_id=0fd8fc33-b306-4ff8-9434-053735c87740)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Creating volume 54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:39 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:39 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 1073741824 Sep 28 17:07:39 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:39 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 1073741824" returned: 0 in 0.690s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:40 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:07:40 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:40 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 0.412s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2463680-676b-4dd1-ba99-2f0ba013a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ef35a0-3752-4279-84da-a83e7d1a50dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:40 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Volume volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 (54b7f7f2-a8c1-4892-a37d-4e9d401dfde3): created successfully Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ef35a0-3752-4279-84da-a83e7d1a50dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (c29099c6-4e52-4f33-927f-e32e5e5dd797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2d55106c-279a-4232-a1d7-e4c969b16922 tempest-GroupSnapshotsTest-1724518088 None] Created volume successfully. Sep 28 17:07:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] GroupSnapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: creating. Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Group snapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: creating. {{(pid=87034) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Creating offline snapshot 3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 of volume 54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a87ff-755a-4faf-9376-c2dfca3b35d6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:42 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:07:42 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:43 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 0.513s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:43 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 1G Sep 28 17:07:43 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:43 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 1G" returned: 0 in 0.825s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:43 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:07:43 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:44 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 0.526s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:44 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:07:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:44 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:07:44 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:44 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:44 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info Sep 28 17:07:44 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:45 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info" returned: 0 in 0.382s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:45 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:07:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:45 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info Sep 28 17:07:45 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:45 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.info" returned: 0 in 0.365s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ef7533ad-120a-42e7-8453-c546e6020a18 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: created successfully Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14-4dd58e4c-6513-4d13-83b4-998f3bc46d61" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14-4dd58e4c-6513-4d13-83b4-998f3bc46d61" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Creating volume 4dd58e4c-6513-4d13-83b4-998f3bc46d61 from snapshot 3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] snapshot: 3102a25b-d6a4-4259-9f9f-6ff5c0b57f14, volume: 4dd58e4c-6513-4d13-83b4-998f3bc46d61, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[78059a70-9409-478a-8592-56fde0124b78]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:48 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:07:48 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:48 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 0.567s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[71377ecc-65bc-4a3d-a2e6-5ab2b6d2e8b4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:48 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:07:48 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:49 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 0.517s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:07:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:07:49 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:07:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:49 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 Sep 28 17:07:49 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:57 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Flow 'volume_create_manager' (b37c102d-fa04-4f80-8119-8ad9e4c251aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fadabee-4257-4921-a487-ad32b79b82c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fadabee-4257-4921-a487-ad32b79b82c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1281673613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d597d01-f38d-4e2d-9978-b0e418b87bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcb2f111044364b8806bc7c09e43c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='eec63b45b81445989b2c52d1c25deb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a804-9325-40c9-b2a2-f01e89dd5eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a804-9325-40c9-b2a2-f01e89dd5eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10c0a46-f3f7-4331-a8ad-6c288ac3972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10c0a46-f3f7-4331-a8ad-6c288ac3972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d597d01-f38d-4e2d-9978-b0e418b87bbf', 'volume_name': 'volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b72a78-fc7e-4018-91b3-97fe0a2acc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b72a78-fc7e-4018-91b3-97fe0a2acc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1f6d6a-39c9-47a1-93b6-d2022fdd4543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume 8d597d01-f38d-4e2d-9978-b0e418b87bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf', 'volume_size': 1} Sep 28 17:07:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:00 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61" returned: 0 in 11.063s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3, size 1024.00 MB, duration 11.06 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:08:00 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Converted 1024.00 MB image at 92.55 MB/s Sep 28 17:08:00 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 Sep 28 17:08:00 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:00 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61" returned: 0 in 0.348s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" released by "_copy_volume_from_snapshot" :: held 12.711s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14-4dd58e4c-6513-4d13-83b4-998f3bc46d61" released by "_create_volume_from_snapshot" :: held 12.832s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.870s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1281673613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d597d01-f38d-4e2d-9978-b0e418b87bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcb2f111044364b8806bc7c09e43c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='eec63b45b81445989b2c52d1c25deb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Creating volume 8d597d01-f38d-4e2d-9978-b0e418b87bbf {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:00 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf 1073741824 Sep 28 17:08:00 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d7d6372b-3997-47d4-8dce-8712ea69d916 tempest-GroupSnapshotsTest-1724518088 None] Create group from source-snapshot-3c844f87-8786-4e40-9d16-ed4936d88c90 completed successfully. Sep 28 17:08:01 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf 1073741824" returned: 0 in 0.927s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf Sep 28 17:08:01 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9a665e-540c-49e5-a30a-f48d44ad778c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 Sep 28 17:08:02 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf" returned: 0 in 0.543s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1f6d6a-39c9-47a1-93b6-d2022fdd4543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b7ac4d-a278-49d5-bcb0-ab73d2c83665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf (8d597d01-f38d-4e2d-9978-b0e418b87bbf): created successfully Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b7ac4d-a278-49d5-bcb0-ab73d2c83665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Flow 'volume_create_manager' (b37c102d-fa04-4f80-8119-8ad9e4c251aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ac750b9e-8e09-4b0a-bf32-f7fe7f524afa tempest-VolumeQuotasAdminTestJSON-843269100 None] Created volume successfully. Sep 28 17:08:02 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61" returned: 0 in 0.551s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61 Sep 28 17:08:02 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:02 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:03 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.383s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:08:03 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4dd58e4c-6513-4d13-83b4-998f3bc46d61" returned: 0 in 0.528s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-4dd58e4c-6513-4d13-83b4-998f3bc46d61" released by "delete_volume" :: held 1.173s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "cinder-8d597d01-f38d-4e2d-9978-b0e418b87bbf-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "cinder-8d597d01-f38d-4e2d-9978-b0e418b87bbf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "cinder-quobyte-8d597d01-f38d-4e2d-9978-b0e418b87bbf" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['2738d136-5f36-421a-ad12-11bbe655779f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "cinder-quobyte-8d597d01-f38d-4e2d-9978-b0e418b87bbf" acquired by "delete_volume" :: waited 0.072s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79dca26-7d27-4e0a-a159-8ef85214da20]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:03 devstack cinder-volume[87034]: WARNING cinder.quota [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1051739362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1051739362, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:03 devstack cinder-volume[87034]: WARNING cinder.quota [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1051739362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1051739362, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:03 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['6ee47a7e-2317-4263-b2fd-1f8435b1be1b', '2b176fbe-b11b-4a1f-ace5-eaa8102fd921', '62a26f0b-260b-4e85-a3b2-ea81cc3db43f', '97491f33-b590-4092-a5ca-5bd6d1904d87'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:03 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf Sep 28 17:08:03 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:04 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf" returned: 0 in 0.929s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf Sep 28 17:08:04 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.674s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1afb4289-6114-4a1f-a396-9363848590b2 tempest-GroupSnapshotsTest-1724518088 None] Delete group completed successfully. Sep 28 17:08:05 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8d597d01-f38d-4e2d-9978-b0e418b87bbf" returned: 0 in 0.595s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "cinder-quobyte-8d597d01-f38d-4e2d-9978-b0e418b87bbf" released by "delete_volume" :: held 1.652s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: deleting Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: deleting {{(pid=87034) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Created reservations ['358746a5-c46a-447c-b985-0b6c3d3d48e5', '6b709833-89ee-4623-8f89-0fabf76719e3', '623b4881-36b9-4ce0-8464-e18839ec0d38', '8f261999-85bf-4964-b892-ae6c55533fab'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Deleting offline snapshot 3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 of volume 54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] snapshot_file for this snap is: volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d50799-3a7f-404d-8c4d-9b72dd164cb0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:05 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:05 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:05 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:08:05 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:06 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.691s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Deleted volume successfully. Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-95ae325a-f01f-4173-b834-f7fc23bf41c7 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "cinder-8d597d01-f38d-4e2d-9978-b0e418b87bbf-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:06 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 1.175s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[373c5be4-b56b-4c17-845d-aa9ebd2f5be1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:08:07 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Flow 'volume_create_manager' (55db5a94-48cc-4d19-829c-0b09d7509b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d182347-a4e8-46cc-be5e-819a89ad2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d182347-a4e8-46cc-be5e-819a89ad2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-759701314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc185af7-7250-4ab2-a8d1-3d6cef69f57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcb2f111044364b8806bc7c09e43c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:07Z,use_quota=True,user_id='eec63b45b81445989b2c52d1c25deb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dfbb1c-1f5e-444e-ae76-8f4a4fef3761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dfbb1c-1f5e-444e-ae76-8f4a4fef3761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b895188-152f-4117-b9db-db4744a0952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b895188-152f-4117-b9db-db4744a0952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc185af7-7250-4ab2-a8d1-3d6cef69f57c', 'volume_name': 'volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2f9a2f-b9d3-42f8-8e10-f0ed33691813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2f9a2f-b9d3-42f8-8e10-f0ed33691813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4656dc-6545-4f0a-a772-d82d4ca59982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:07 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume cc185af7-7250-4ab2-a8d1-3d6cef69f57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c', 'volume_size': 1} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-759701314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc185af7-7250-4ab2-a8d1-3d6cef69f57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcb2f111044364b8806bc7c09e43c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:07Z,use_quota=True,user_id='eec63b45b81445989b2c52d1c25deb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Creating volume cc185af7-7250-4ab2-a8d1-3d6cef69f57c {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:07 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c 1073741824 Sep 28 17:08:07 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 1.201s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:08:08 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 0.703s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14 Sep 28 17:08:08 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c 1073741824" returned: 0 in 1.277s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:09 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c Sep 28 17:08:09 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3.3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" returned: 0 in 0.366s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3102a25b-d6a4-4259-9f9f-6ff5c0b57f14" released by "_delete_snapshot" :: held 3.726s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" released by "delete_snapshot" :: held 3.818s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:09 devstack cinder-volume[87034]: WARNING cinder.quota [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1051739362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1051739362, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['9d511211-f767-4a31-ad5a-eb47d1f1ebf9', 'dbbd4bc1-acb5-4d0c-af0f-a64636e6860b', '3dbcc748-51c8-4e9f-822a-bade4f8ca814', '081ef2ac-d054-4150-b3b0-13312cf5da6d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2feaac68-b98f-4987-ac33-3ef99cef9b2a tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 3c844f87-8786-4e40-9d16-ed4936d88c90: deleted successfully Sep 28 17:08:09 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" returned: 0 in 0.579s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4656dc-6545-4f0a-a772-d82d4ca59982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eb3d58-36b7-47a1-9cfd-dd5febab078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:09 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Volume volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c (cc185af7-7250-4ab2-a8d1-3d6cef69f57c): created successfully Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8eb3d58-36b7-47a1-9cfd-dd5febab078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Flow 'volume_create_manager' (55db5a94-48cc-4d19-829c-0b09d7509b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d583ece8-c819-4088-a611-973ee5dbe944 tempest-VolumeQuotasAdminTestJSON-843269100 None] Created volume successfully. Sep 28 17:08:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[480df3a6-79b7-4564-9bb0-2ddb010350bc]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:10 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:08:10 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (d6c427d2-75c2-4d2e-bb2a-619b7c2a6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45d4fbe-825f-4476-a7ed-e996718812cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:11 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45d4fbe-825f-4476-a7ed-e996718812cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192677217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ae071-89fe-468f-821e-e286f7fcca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:11Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47389db3-58f1-4d0a-87f7-d244d89bb4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47389db3-58f1-4d0a-87f7-d244d89bb4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc0d1bd-062f-4172-9f9d-d5ea349afa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc0d1bd-062f-4172-9f9d-d5ea349afa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3ae071-89fe-468f-821e-e286f7fcca9b', 'volume_name': 'volume-6f3ae071-89fe-468f-821e-e286f7fcca9b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e9e159-a179-4093-bd54-20b67d4628a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e9e159-a179-4093-bd54-20b67d4628a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378e822c-01a7-4089-9026-9dfd7a889486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:11 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Volume 6f3ae071-89fe-468f-821e-e286f7fcca9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3ae071-89fe-468f-821e-e286f7fcca9b', 'volume_size': 1} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192677217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ae071-89fe-468f-821e-e286f7fcca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:11Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Creating volume 6f3ae071-89fe-468f-821e-e286f7fcca9b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:11 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 0.871s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:11 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b 1073741824 Sep 28 17:08:11 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:11 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3 Sep 28 17:08:11 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:11 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" returned: 0 in 0.492s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-54b7f7f2-a8c1-4892-a37d-4e9d401dfde3" released by "delete_volume" :: held 1.529s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['7866ce26-5fa5-492b-bba4-c0052af7d875'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:12 devstack cinder-volume[87034]: WARNING cinder.db.api [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1051739362'] Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['ca313f2a-c1ec-4c35-ac47-9e8af82946a9', '77394368-d06c-4135-9aa9-2e3c0b68ff6e', 'b70735be-9fa7-41e7-beff-bf790128ad8c', 'eb11baa7-2e6f-4447-8e7c-06196683f159'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:12 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b 1073741824" returned: 0 in 0.941s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:12 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b Sep 28 17:08:12 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c89658ec-c294-4604-ab97-80ac07313ffc tempest-VolumeQuotasAdminTestJSON-686720174 None] Transfer volume completed successfully. Sep 28 17:08:12 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:12 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:13 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.443s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3df9ecf3-424b-47f9-bd0c-942389930349 tempest-GroupSnapshotsTest-1724518088 None] Delete group completed successfully. Sep 28 17:08:13 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b" returned: 0 in 0.585s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378e822c-01a7-4089-9026-9dfd7a889486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3ae071-89fe-468f-821e-e286f7fcca9b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e38b0c3-3cf4-43a7-a02f-712fe7fccd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:13 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Volume volume-6f3ae071-89fe-468f-821e-e286f7fcca9b (6f3ae071-89fe-468f-821e-e286f7fcca9b): created successfully Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e38b0c3-3cf4-43a7-a02f-712fe7fccd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (d6c427d2-75c2-4d2e-bb2a-619b7c2a6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-619322de-4c2f-4743-aa1a-333db01fc8bc tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Acquiring lock "cinder-cc185af7-7250-4ab2-a8d1-3d6cef69f57c-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "cinder-cc185af7-7250-4ab2-a8d1-3d6cef69f57c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-77f37dc8-1e6f-4440-a86f-9d2fafcc4b9f tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b" by "attach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Acquiring lock "cinder-quobyte-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-77f37dc8-1e6f-4440-a86f-9d2fafcc4b9f tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b" acquired by "attach_volume" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "cinder-quobyte-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" acquired by "delete_volume" :: waited 0.073s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051d64c-546d-42da-b534-75976ac211cf]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-77f37dc8-1e6f-4440-a86f-9d2fafcc4b9f tempest-VolumesActionsTest-290627148 None] Attaching volume 6f3ae071-89fe-468f-821e-e286f7fcca9b to instance a60cee68-c191-45fb-b100-5f7e5eec59be at mountpoint /dev/vdb on host None. Sep 28 17:08:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-77f37dc8-1e6f-4440-a86f-9d2fafcc4b9f tempest-VolumesActionsTest-290627148 None] Attach volume completed successfully. Sep 28 17:08:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-77f37dc8-1e6f-4440-a86f-9d2fafcc4b9f tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b" released by "attach_volume" :: held 0.253s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:13 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c Sep 28 17:08:13 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-79c02562-8873-4095-9c3f-e8109edb9c50 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-1712568341: creating Sep 28 17:08:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-79c02562-8873-4095-9c3f-e8109edb9c50 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-1712568341: created successfully Sep 28 17:08:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-79c02562-8873-4095-9c3f-e8109edb9c50 tempest-GroupSnapshotsTest-1724518088 None] Create group completed successfully. Sep 28 17:08:14 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" returned: 0 in 0.778s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:14 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c Sep 28 17:08:14 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Terminate volume connection completed successfully. Sep 28 17:08:14 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" returned: 0 in 0.383s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" by "detach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "cinder-quobyte-cc185af7-7250-4ab2-a8d1-3d6cef69f57c" released by "delete_volume" :: held 1.246s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Detaching volume 6f3ae071-89fe-468f-821e-e286f7fcca9b from instance a60cee68-c191-45fb-b100-5f7e5eec59be. Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Created reservations ['8a45d8da-8e11-4111-b069-e1cfaba1ac93', '07f210a0-5d6b-461d-9cf4-85451886310c', 'ff9825bd-76a1-4756-9eeb-5ca696848626', 'b240f8a9-6a6b-4df4-b352-253525e1ece1'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Detach volume completed successfully. Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e5ce2f40-e4ec-4e3c-b1e3-8372d34f0a79 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" released by "detach_volume" :: held 0.185s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:15 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:15 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3e1ef7b-f877-4f69-80d9-c57782daa6e5 tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" by "detach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3e1ef7b-f877-4f69-80d9-c57782daa6e5 tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e3e1ef7b-f877-4f69-80d9-c57782daa6e5 tempest-VolumesActionsTest-290627148 None] Volume detach called, but volume not attached. Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3e1ef7b-f877-4f69-80d9-c57782daa6e5 tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:15 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.567s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Deleted volume successfully. Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9b50494e-b841-4184-8fe7-ef45a199df2c tempest-VolumeQuotasAdminTestJSON-640993043 None] Lock "cinder-cc185af7-7250-4ab2-a8d1-3d6cef69f57c-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-quobyte-6f3ae071-89fe-468f-821e-e286f7fcca9b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "cinder-quobyte-6f3ae071-89fe-468f-821e-e286f7fcca9b" acquired by "delete_volume" :: waited 0.065s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6fefad-27cc-4992-a0f0-6ac55d5653a8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:16 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b Sep 28 17:08:16 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (6fdf19bb-3e89-4659-afe6-f3b958c07e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e93ef62-6078-42a2-965e-b04b247661fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e93ef62-6078-42a2-965e-b04b247661fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212400991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,host='devstack@QuobyteHD#QuobyteHD',id=b6978d01-039e-43cb-96a1-f3a52d0dce84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:16Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03955014-6325-4a90-9b86-7a947ab2aca2),volume_type_id=03955014-6325-4a90-9b86-7a947ab2aca2)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e7e0f4-2c4c-4165-afdd-8957a9eed43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e7e0f4-2c4c-4165-afdd-8957a9eed43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18edf5b-fee6-404f-8a07-92c4f1644994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18edf5b-fee6-404f-8a07-92c4f1644994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6978d01-039e-43cb-96a1-f3a52d0dce84', 'volume_name': 'volume-b6978d01-039e-43cb-96a1-f3a52d0dce84', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bf0c1e-672c-422b-a3fc-0f46d269a7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bf0c1e-672c-422b-a3fc-0f46d269a7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd84076-579d-487b-a920-26f03e7f0f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Volume b6978d01-039e-43cb-96a1-f3a52d0dce84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6978d01-039e-43cb-96a1-f3a52d0dce84', 'volume_size': 1} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,created_at=2026-09-28T15:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212400991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,host='devstack@QuobyteHD#QuobyteHD',id=b6978d01-039e-43cb-96a1-f3a52d0dce84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:16Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03955014-6325-4a90-9b86-7a947ab2aca2),volume_type_id=03955014-6325-4a90-9b86-7a947ab2aca2)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Creating volume b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:16 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:17 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b" returned: 0 in 0.676s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:17 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 1073741824 Sep 28 17:08:17 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:17 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b Sep 28 17:08:17 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:17 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6f3ae071-89fe-468f-821e-e286f7fcca9b" returned: 0 in 0.602s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "cinder-quobyte-6f3ae071-89fe-468f-821e-e286f7fcca9b" released by "delete_volume" :: held 1.426s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:17 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Created reservations ['b9002392-1f4d-4bca-9d9b-9e16c0306413', '9006d5e4-321d-471e-ac94-2096cb60f492', '6fb23264-0bb3-41fb-a91d-8d509e5981a3', 'faf9da75-67c7-48fb-a138-2ce051a71a9f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:18 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 1073741824" returned: 0 in 1.149s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:18 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:18 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:18 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 Sep 28 17:08:18 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:19 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.702s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Deleted volume successfully. Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14ff9a77-11ff-4ffd-affa-123472ea843b tempest-VolumesActionsTest-290627148 None] Lock "cinder-6f3ae071-89fe-468f-821e-e286f7fcca9b-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:19 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84" returned: 0 in 1.133s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.596s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd84076-579d-487b-a920-26f03e7f0f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6978d01-039e-43cb-96a1-f3a52d0dce84', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7233abaa-b371-4e37-9419-3c54a0760f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:19 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Volume volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 (b6978d01-039e-43cb-96a1-f3a52d0dce84): created successfully Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7233abaa-b371-4e37-9419-3c54a0760f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (6fdf19bb-3e89-4659-afe6-f3b958c07e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-531ca4f1-6ccd-4332-b2e0-fcc2f9aeb04b tempest-GroupSnapshotsTest-1724518088 None] Created volume successfully. Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (21d55c20-ee88-4786-808a-150e532a4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4816385-1cd4-4ba2-9a5e-c04f2cc5dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4816385-1cd4-4ba2-9a5e-c04f2cc5dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280209038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,host='devstack@QuobyteHD#QuobyteHD',id=d9f9bd50-929f-4764-a130-8d4761915971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03955014-6325-4a90-9b86-7a947ab2aca2),volume_type_id=03955014-6325-4a90-9b86-7a947ab2aca2)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93396839-cbed-44c2-aad8-9bc413c83f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93396839-cbed-44c2-aad8-9bc413c83f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59de166b-fe9f-48c9-9f5c-8f23f4602463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59de166b-fe9f-48c9-9f5c-8f23f4602463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f9bd50-929f-4764-a130-8d4761915971', 'volume_name': 'volume-d9f9bd50-929f-4764-a130-8d4761915971', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08943c94-87b5-42de-b012-0fc89c9b86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08943c94-87b5-42de-b012-0fc89c9b86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a296edc-e9e5-475b-9f3a-a6f0b8198810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Volume d9f9bd50-929f-4764-a130-8d4761915971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f9bd50-929f-4764-a130-8d4761915971', 'volume_size': 1} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,created_at=2026-09-28T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280209038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e75548ab-0ec1-4a14-8be7-b17f16c23d75,host='devstack@QuobyteHD#QuobyteHD',id=d9f9bd50-929f-4764-a130-8d4761915971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03955014-6325-4a90-9b86-7a947ab2aca2),volume_type_id=03955014-6325-4a90-9b86-7a947ab2aca2)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Creating volume d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 1073741824 Sep 28 17:08:21 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 1073741824" returned: 0 in 0.781s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:22 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 Sep 28 17:08:22 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971" returned: 0 in 0.393s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a296edc-e9e5-475b-9f3a-a6f0b8198810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f9bd50-929f-4764-a130-8d4761915971', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576a6049-5b63-43db-a5d8-3ab5bce227dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Volume volume-d9f9bd50-929f-4764-a130-8d4761915971 (d9f9bd50-929f-4764-a130-8d4761915971): created successfully Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576a6049-5b63-43db-a5d8-3ab5bce227dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (21d55c20-ee88-4786-808a-150e532a4519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-080ee304-8b94-4cff-aac6-8761b4b24f3d tempest-GroupSnapshotsTest-1724518088 None] Created volume successfully. Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (1f83b600-d954-496a-93d5-c2c0abace0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e2f12-d5d2-41d4-bdda-7b758eb597fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e2f12-d5d2-41d4-bdda-7b758eb597fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1931081659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58da86fd-22bb-4f53-a872-64f37402de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:24Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0863d48a-c17f-4c1f-8a6a-a464b71eeab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0863d48a-c17f-4c1f-8a6a-a464b71eeab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38715e5f-52c0-4cd3-8901-6960b0ab9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38715e5f-52c0-4cd3-8901-6960b0ab9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58da86fd-22bb-4f53-a872-64f37402de66', 'volume_name': 'volume-58da86fd-22bb-4f53-a872-64f37402de66', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76257aa4-7060-4fb9-901f-b774351a510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76257aa4-7060-4fb9-901f-b774351a510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c4eeef-0433-4871-8c02-75d1c4bacfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Volume 58da86fd-22bb-4f53-a872-64f37402de66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58da86fd-22bb-4f53-a872-64f37402de66', 'volume_size': 1} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1931081659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58da86fd-22bb-4f53-a872-64f37402de66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:24Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Creating volume 58da86fd-22bb-4f53-a872-64f37402de66 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:24 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:24 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 1073741824 Sep 28 17:08:24 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4d015be1-61bf-4f1b-9422-b3a00d6aefaa tempest-GroupSnapshotsTest-1724518088 None] Update group completed successfully. Sep 28 17:08:25 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 1073741824" returned: 0 in 0.692s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:25 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 Sep 28 17:08:25 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f0199462-1d6d-4eff-ade2-e6683e6b8d3e tempest-GroupSnapshotsTest-1724518088 None] Update group completed successfully. Sep 28 17:08:25 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66" returned: 0 in 0.708s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c4eeef-0433-4871-8c02-75d1c4bacfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58da86fd-22bb-4f53-a872-64f37402de66', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43bfaa-7a62-4735-8722-d4576dfdb3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Volume volume-58da86fd-22bb-4f53-a872-64f37402de66 (58da86fd-22bb-4f53-a872-64f37402de66): created successfully Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc43bfaa-7a62-4735-8722-d4576dfdb3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (1f83b600-d954-496a-93d5-c2c0abace0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-347a08b6-2629-42bd-a400-3ae14f585549 tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-58da86fd-22bb-4f53-a872-64f37402de66-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-58da86fd-22bb-4f53-a872-64f37402de66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-quobyte-58da86fd-22bb-4f53-a872-64f37402de66" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-58da86fd-22bb-4f53-a872-64f37402de66" acquired by "delete_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb240bff-f4e7-4199-9917-b44ed79982ff]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:26 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 Sep 28 17:08:26 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-55b5f618-65b4-4f27-8cad-ca7d5595b10b tempest-GroupSnapshotsTest-1724518088 None] Update group completed successfully. Sep 28 17:08:27 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66" returned: 0 in 0.593s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:27 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66 Sep 28 17:08:27 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:27 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-58da86fd-22bb-4f53-a872-64f37402de66" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-58da86fd-22bb-4f53-a872-64f37402de66" released by "delete_volume" :: held 0.995s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Created reservations ['20926875-f9dc-4c7b-bcb7-dd5a796e0628', '5667afbf-65fc-43d6-a27e-0dca8c33b6b1', '38a0da92-0194-4b70-af05-78731d09d84a', '2c6ef0d8-4364-4763-8009-e991f0427042'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:28 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:28 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:28 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.340s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:28 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Deleted volume successfully. Sep 28 17:08:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c3e6c84-0e3e-4af4-a443-f0f6e41e48c0 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-58da86fd-22bb-4f53-a872-64f37402de66-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-465eb1df-6546-4ad6-815b-d30b49d0e070 tempest-GroupSnapshotsTest-1724518088 None] Update group completed successfully. Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (f53e7b5c-45cd-4b0a-9608-255c0f342484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31296f65-46f5-440b-a633-0a2592a7c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31296f65-46f5-440b-a633-0a2592a7c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793206691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c756a22f-c7aa-468b-9496-2b8ffb1be240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:30Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad7aa45-1f4e-4e24-a2f6-e23e919ffd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad7aa45-1f4e-4e24-a2f6-e23e919ffd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76aff88-3619-4d1a-ac16-947c792fd9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76aff88-3619-4d1a-ac16-947c792fd9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c756a22f-c7aa-468b-9496-2b8ffb1be240', 'volume_name': 'volume-c756a22f-c7aa-468b-9496-2b8ffb1be240', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d196f160-6af6-4308-9df6-664963de6669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d196f160-6af6-4308-9df6-664963de6669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50292f8-f378-44a9-ae9f-4c0a8590db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:29 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Volume c756a22f-c7aa-468b-9496-2b8ffb1be240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c756a22f-c7aa-468b-9496-2b8ffb1be240', 'volume_size': 1} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793206691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c756a22f-c7aa-468b-9496-2b8ffb1be240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:30Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Creating volume c756a22f-c7aa-468b-9496-2b8ffb1be240 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:30 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:30 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 1073741824 Sep 28 17:08:30 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] GroupSnapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: creating. Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Group snapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: creating. {{(pid=87034) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:30 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 1073741824" returned: 0 in 0.907s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:31 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 Sep 28 17:08:31 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:31 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240" returned: 0 in 0.526s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Creating offline snapshot 71f86114-b397-455e-b3bc-c96d2d805bab of volume b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50292f8-f378-44a9-ae9f-4c0a8590db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c756a22f-c7aa-468b-9496-2b8ffb1be240', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b4b43b-ddff-4c70-a426-0c5ec0c351e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f196bd-01d9-42fc-9ae9-ee9cad4923c6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:31 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Volume volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 (c756a22f-c7aa-468b-9496-2b8ffb1be240): created successfully Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b4b43b-ddff-4c70-a426-0c5ec0c351e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (f53e7b5c-45cd-4b0a-9608-255c0f342484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3a436149-a867-48ac-aa9b-f06606607d77 tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:31 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 Sep 28 17:08:31 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:32 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84" returned: 0 in 0.842s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab 1G Sep 28 17:08:32 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-c756a22f-c7aa-468b-9496-2b8ffb1be240-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-c756a22f-c7aa-468b-9496-2b8ffb1be240-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-quobyte-c756a22f-c7aa-468b-9496-2b8ffb1be240" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-c756a22f-c7aa-468b-9496-2b8ffb1be240" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[74161240-4e05-4938-bdb5-c744ffca8e8c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 Sep 28 17:08:32 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab 1G" returned: 0 in 0.934s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab Sep 28 17:08:33 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240" returned: 0 in 0.720s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240 Sep 28 17:08:33 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:33 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Flow 'volume_create_manager' (1c517793-d49e-4905-aa4a-64f901ab4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc130bd-5200-48f9-88a7-f277862c6115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:33 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab" returned: 0 in 0.548s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c756a22f-c7aa-468b-9496-2b8ffb1be240" returned: 0 in 0.476s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc130bd-5200-48f9-88a7-f277862c6115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-745296934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a386ed05-8c99-4453-9ef0-d09ba8516b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c16defeeb6a49c1a531d99d15cffd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:34Z,use_quota=True,user_id='eb5e63626e1840b0a0d778190f54a3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:33 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ceb6ec-5ae1-4674-933f-d5d9fbe9148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ceb6ec-5ae1-4674-933f-d5d9fbe9148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa9d5fe-5520-4aa1-b468-c671c74acf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa9d5fe-5520-4aa1-b468-c671c74acf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a386ed05-8c99-4453-9ef0-d09ba8516b7f', 'volume_name': 'volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5f55d2-28da-43fd-9d9c-ac4a738c7b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5f55d2-28da-43fd-9d9c-ac4a738c7b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedb5c8b-a552-4571-b700-e19829bb35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Volume a386ed05-8c99-4453-9ef0-d09ba8516b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f', 'volume_size': 1} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-c756a22f-c7aa-468b-9496-2b8ffb1be240" released by "delete_volume" :: held 1.320s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Created reservations ['f1f2f6ff-907c-4a49-ad95-a3c7a16fbcb0', '2d55362f-4a5d-4b02-966b-0301b7acdf6d', '8e75fb14-f893-4b39-927f-29b4b4257e4b', '94cfc67a-ffad-415f-8f53-8b53dbab7e00'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:34 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:34 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:34 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab" returned: 0 in 0.338s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:34 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info Sep 28 17:08:34 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:34 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.305s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Deleted volume successfully. Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9e026e00-9f05-44a8-9ce4-b616e50cf9f5 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-c756a22f-c7aa-468b-9496-2b8ffb1be240-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:34 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info" returned: 0 in 0.310s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:34 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info Sep 28 17:08:34 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.info" returned: 0 in 0.416s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.546s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Creating offline snapshot f3cf247e-a6f9-4570-92c2-b2fd8fe65bba of volume d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a87071-d22c-48e4-a37c-6c87945cc5e5]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:35 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 Sep 28 17:08:35 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (329d473d-ca4f-45ab-abed-7f38c320a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ef05e5-de5f-4e95-85b8-41f9eddaa232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971" returned: 0 in 0.516s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ef05e5-de5f-4e95-85b8-41f9eddaa232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-398930863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa9eb05-15c7-4302-957e-03435b390401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:36Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba 1G Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ef0396-73c2-496e-aff6-66b9c13e9d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ef0396-73c2-496e-aff6-66b9c13e9d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379524c7-2bfa-4a3f-b6c0-d1eaf385e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379524c7-2bfa-4a3f-b6c0-d1eaf385e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa9eb05-15c7-4302-957e-03435b390401', 'volume_name': 'volume-aaa9eb05-15c7-4302-957e-03435b390401', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1633286-dde3-4028-803d-21672393899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1633286-dde3-4028-803d-21672393899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c629b1-e8bc-4da1-b105-1ea8bbee77f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Volume aaa9eb05-15c7-4302-957e-03435b390401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa9eb05-15c7-4302-957e-03435b390401', 'volume_size': 1} Sep 28 17:08:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:36 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba 1G" returned: 0 in 0.511s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f9bd50-929f-4764-a130-8d4761915971 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:36 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f9bd50-929f-4764-a130-8d4761915971 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba Sep 28 17:08:36 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:36 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f9bd50-929f-4764-a130-8d4761915971 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" returned: 0 in 0.387s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:36 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:36 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba Sep 28 17:08:36 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:36 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" returned: 0 in 0.361s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:36 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info Sep 28 17:08:36 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:37 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info" returned: 0 in 0.310s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:37 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:37 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info Sep 28 17:08:37 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:37 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.info" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.579s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-745296934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a386ed05-8c99-4453-9ef0-d09ba8516b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c16defeeb6a49c1a531d99d15cffd48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:34Z,use_quota=True,user_id='eb5e63626e1840b0a0d778190f54a3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Creating volume a386ed05-8c99-4453-9ef0-d09ba8516b7f {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:37 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:37 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f 1073741824 Sep 28 17:08:37 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-14410e3b-cb4c-49ee-9828-c25f8c240cd9 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: created successfully Sep 28 17:08:38 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f 1073741824" returned: 0 in 0.613s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:38 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f Sep 28 17:08:38 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: deleting Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: deleting {{(pid=87034) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:38 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-71f86114-b397-455e-b3bc-c96d2d805bab" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f" returned: 0 in 0.365s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.937s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-398930863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa9eb05-15c7-4302-957e-03435b390401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:36Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Creating volume aaa9eb05-15c7-4302-957e-03435b390401 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-71f86114-b397-455e-b3bc-c96d2d805bab" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Deleting offline snapshot 71f86114-b397-455e-b3bc-c96d2d805bab of volume b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:38 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 1073741824 Sep 28 17:08:38 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] snapshot_file for this snap is: volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedb5c8b-a552-4571-b700-e19829bb35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304f010c-a92a-4b96-86b6-94854f0bbdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf02ced-063d-497e-93fc-ab3765acca0a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Volume volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f (a386ed05-8c99-4453-9ef0-d09ba8516b7f): created successfully Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304f010c-a92a-4b96-86b6-94854f0bbdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Flow 'volume_create_manager' (1c517793-d49e-4905-aa4a-64f901ab4f81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b3962bd0-9956-4ee6-a211-fe6bfb665810 tempest-VolumesServicesTestJSON-448175829 None] Created volume successfully. Sep 28 17:08:39 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab Sep 28 17:08:39 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 1073741824" returned: 0 in 0.727s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Acquiring lock "cinder-a386ed05-8c99-4453-9ef0-d09ba8516b7f-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:39 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 Sep 28 17:08:39 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "cinder-a386ed05-8c99-4453-9ef0-d09ba8516b7f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:39 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab" returned: 0 in 0.756s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6978d01-039e-43cb-96a1-f3a52d0dce84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a434dba-b94d-4570-8e4f-fccc1e1fa13a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Acquiring lock "cinder-quobyte-a386ed05-8c99-4453-9ef0-d09ba8516b7f" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "cinder-quobyte-a386ed05-8c99-4453-9ef0-d09ba8516b7f" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e9f42b-d741-47c6-93d3-3ca9fb179bc6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:39 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 Sep 28 17:08:39 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401" returned: 0 in 0.419s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c629b1-e8bc-4da1-b105-1ea8bbee77f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa9eb05-15c7-4302-957e-03435b390401', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:39 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f Sep 28 17:08:39 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb5ea42-5b8d-44bc-9225-15ddfe4da5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Volume volume-aaa9eb05-15c7-4302-957e-03435b390401 (aaa9eb05-15c7-4302-957e-03435b390401): created successfully Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb5ea42-5b8d-44bc-9225-15ddfe4da5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (329d473d-ca4f-45ab-abed-7f38c320a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dbc32e02-0550-48eb-b1ae-c2b0a43a185f tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:40 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84" returned: 0 in 0.523s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:40 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab Sep 28 17:08:40 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:40 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f" returned: 0 in 0.571s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:40 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f Sep 28 17:08:40 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:40 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab" returned: 0 in 0.424s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:40 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab Sep 28 17:08:40 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:40 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a386ed05-8c99-4453-9ef0-d09ba8516b7f" returned: 0 in 0.315s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "cinder-quobyte-a386ed05-8c99-4453-9ef0-d09ba8516b7f" released by "delete_volume" :: held 0.976s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Created reservations ['7582942d-b8d6-4122-8ed5-ae499bc95e48', '9a496a65-cc7f-4f20-a665-26177e0f6a98', '0ee8f3ab-1d95-4bfc-b2a7-082841d021df', '9b58d104-fb04-41ac-98dd-4f16402c2d05'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:40 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:40 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:40 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84.71f86114-b397-455e-b3bc-c96d2d805bab" returned: 0 in 0.400s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-71f86114-b397-455e-b3bc-c96d2d805bab" released by "_delete_snapshot" :: held 2.320s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" released by "delete_snapshot" :: held 2.400s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Deleting offline snapshot f3cf247e-a6f9-4570-92c2-b2fd8fe65bba of volume d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] snapshot_file for this snap is: volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffa1514-127a-4f7e-a2de-abe3b29e061a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-aaa9eb05-15c7-4302-957e-03435b390401-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Deleted volume successfully. Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "cinder-aaa9eb05-15c7-4302-957e-03435b390401-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bf1d02bd-560a-41bb-8065-125db2feec23 tempest-VolumesServicesTestJSON-448175829 None] Lock "cinder-a386ed05-8c99-4453-9ef0-d09ba8516b7f-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-quobyte-aaa9eb05-15c7-4302-957e-03435b390401" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-aaa9eb05-15c7-4302-957e-03435b390401" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e405efa-0288-4cbe-bafa-604871ab6eab]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:41 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba Sep 28 17:08:41 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:41 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 Sep 28 17:08:41 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:41 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" returned: 0 in 0.642s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f9bd50-929f-4764-a130-8d4761915971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:41 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401" returned: 0 in 0.479s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b48711-c568-4643-a48a-25b9144c40a6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:41 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401 Sep 28 17:08:41 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 Sep 28 17:08:42 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-aaa9eb05-15c7-4302-957e-03435b390401" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-aaa9eb05-15c7-4302-957e-03435b390401" released by "delete_volume" :: held 1.020s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Created reservations ['f2e7de14-d17e-40ae-905f-21e1b42e1440', '3b240fa8-f59a-4d89-9ae5-a7ea0d421359', '1a7c0ffe-5388-451b-a4a9-71d1d9491562', '01e67bd2-d44e-49ae-bf43-6f44d29430ab'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:42 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971" returned: 0 in 0.835s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:42 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba Sep 28 17:08:42 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:43 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.374s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Deleted volume successfully. Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7766a493-9048-4677-a8a2-f92a975296ba tempest-VolumesActionsTest-1630000449 None] Lock "cinder-aaa9eb05-15c7-4302-957e-03435b390401-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:43 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" returned: 0 in 0.529s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:43 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba Sep 28 17:08:43 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:43 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971.f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" returned: 0 in 0.349s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-f3cf247e-a6f9-4570-92c2-b2fd8fe65bba" released by "_delete_snapshot" :: held 2.560s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" released by "delete_snapshot" :: held 2.612s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:43 devstack cinder-volume[87034]: WARNING cinder.quota [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1040001951 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1040001951, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:43 devstack cinder-volume[87034]: WARNING cinder.quota [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1040001951 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1040001951, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['fd55dac8-4d69-4552-9282-151e3276cb4e', '9e727bef-af95-4809-bb15-94b0b0de1b5c', '4f228515-f7ba-4237-80f6-c16601037b8c', 'ff48a77b-36ec-4b4d-97d5-f080fcc2dafb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:43 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['27ed6861-41f0-4804-b366-f2145be27285', '9c577766-07c4-4d75-9f7d-4434040e81b6', 'befd02de-3c70-4c35-87f1-8f254d16f81e', '4e73e6a9-a932-4dc1-bef3-19e860ed1471'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ea9287eb-a3b3-4e67-aad8-e9fc96b38839 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot bdd36ac7-e605-4121-b980-fc6d1ad61f15: deleted successfully Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (189b20b5-810e-4cf9-a4da-43687edb8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c927b3d5-3d7c-4919-9241-7247281dd04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c927b3d5-3d7c-4919-9241-7247281dd04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972410037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290d9a6e-fe75-4456-8577-69e3462177b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:44Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9693a9-516d-417e-aeb4-8e158afb3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9693a9-516d-417e-aeb4-8e158afb3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aada6269-67fa-4958-ab63-b20b14bc15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aada6269-67fa-4958-ab63-b20b14bc15c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290d9a6e-fe75-4456-8577-69e3462177b8', 'volume_name': 'volume-290d9a6e-fe75-4456-8577-69e3462177b8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd442a5e-b11c-445f-8f72-506f80ed2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd442a5e-b11c-445f-8f72-506f80ed2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5ea30d-1ceb-496a-95e7-ad3b48609ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Volume 290d9a6e-fe75-4456-8577-69e3462177b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290d9a6e-fe75-4456-8577-69e3462177b8', 'volume_size': 1} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972410037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290d9a6e-fe75-4456-8577-69e3462177b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:44Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Creating volume 290d9a6e-fe75-4456-8577-69e3462177b8 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:44 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 1073741824 Sep 28 17:08:44 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" acquired by "delete_volume" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678a7cb-2a6d-40d4-8e85-7c07227dafb4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:45 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 1073741824" returned: 0 in 0.712s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 Sep 28 17:08:45 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:45 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 Sep 28 17:08:45 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84" returned: 0 in 0.558s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:45 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8" returned: 0 in 0.357s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:45 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84 Sep 28 17:08:45 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5ea30d-1ceb-496a-95e7-ad3b48609ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290d9a6e-fe75-4456-8577-69e3462177b8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d210f-22e3-4ada-ae0d-8871ca246fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Volume volume-290d9a6e-fe75-4456-8577-69e3462177b8 (290d9a6e-fe75-4456-8577-69e3462177b8): created successfully Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162d210f-22e3-4ada-ae0d-8871ca246fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (189b20b5-810e-4cf9-a4da-43687edb8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4781f0d6-b94d-4601-a204-3d0a2e2f197b tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:45 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b6978d01-039e-43cb-96a1-f3a52d0dce84" returned: 0 in 0.315s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-b6978d01-039e-43cb-96a1-f3a52d0dce84" released by "delete_volume" :: held 0.967s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05d7ed8-f8f7-49fc-af39-09daaa68d46e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:46 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 Sep 28 17:08:46 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:46 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971" returned: 0 in 0.550s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:46 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971 Sep 28 17:08:46 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-290d9a6e-fe75-4456-8577-69e3462177b8-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-290d9a6e-fe75-4456-8577-69e3462177b8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "cinder-quobyte-290d9a6e-fe75-4456-8577-69e3462177b8" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-290d9a6e-fe75-4456-8577-69e3462177b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dce81a-15c8-4d8c-bfeb-f2299f6103da]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:47 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d9f9bd50-929f-4764-a130-8d4761915971" returned: 0 in 0.404s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:47 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 Sep 28 17:08:47 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-d9f9bd50-929f-4764-a130-8d4761915971" released by "delete_volume" :: held 1.043s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['7371dc2e-457b-49f6-a671-a404b2bbc607'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:47 devstack cinder-volume[87034]: WARNING cinder.quota [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1040001951 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1040001951, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['841b3161-7e4e-4f42-ba9d-0fadb4122ffb', '14e5b4dd-e531-4a97-b3db-e1927da76a10', '92f630ed-ed81-47e0-b579-125219d519d4', 'a968f021-1a33-4783-b73c-9bb8f6489bcf'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:47 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8" returned: 0 in 0.494s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:47 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8 Sep 28 17:08:47 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['34ad5c68-072b-42c6-97ca-527da9e620e6', '3633bedc-54fe-4717-9d94-c1ee42b101bc', 'cc0414ed-10ef-465b-91d4-b179010caede', 'de5ccb60-9836-414a-bc28-95094e38b0da'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:47 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:47 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:47 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-290d9a6e-fe75-4456-8577-69e3462177b8" returned: 0 in 0.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-quobyte-290d9a6e-fe75-4456-8577-69e3462177b8" released by "delete_volume" :: held 0.975s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Created reservations ['1a6c23b4-87d8-4f90-9a4f-322f2225dd89', '0dcd571b-0512-4455-bc14-1d8ad1ba61b2', '404d5ffd-526d-41cc-872e-168f9853e8ec', '6236795a-38a8-4251-969f-6995aa57c4b4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:48 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:48 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:48 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.410s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1e063ee7-2d95-4e5a-9e49-3a13b8ab5f65 tempest-GroupSnapshotsTest-1724518088 None] Delete group completed successfully. Sep 28 17:08:48 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.355s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Deleted volume successfully. Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-239a3293-6ef1-43f4-8e2e-6d2852f2dc95 tempest-VolumesActionsTest-1630000449 None] Lock "cinder-290d9a6e-fe75-4456-8577-69e3462177b8-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Flow 'volume_create_manager' (759ea0de-1a13-4040-aa94-028015fbac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b1164b-a64e-43c0-9f21-d99332852b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b1164b-a64e-43c0-9f21-d99332852b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476567031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d9059c-a189-41cc-b733-6571d1c9010a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbe6010984c430c80d2f699a3314fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='782af78cbc734c2c98c23c4148137d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bd356a-1aa9-4c3b-9073-e950c323f434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bd356a-1aa9-4c3b-9073-e950c323f434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d68aa77-1128-4f11-a1b6-7dcb903605f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d68aa77-1128-4f11-a1b6-7dcb903605f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d9059c-a189-41cc-b733-6571d1c9010a', 'volume_name': 'volume-c2d9059c-a189-41cc-b733-6571d1c9010a', 'volume_size': 2}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1b3765-d6f6-4d7f-a4eb-7ac1ce9d1ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1b3765-d6f6-4d7f-a4eb-7ac1ce9d1ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d573126-cbf5-4271-a2a8-7935882ed0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Volume c2d9059c-a189-41cc-b733-6571d1c9010a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d9059c-a189-41cc-b733-6571d1c9010a', 'volume_size': 2} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-476567031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d9059c-a189-41cc-b733-6571d1c9010a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbe6010984c430c80d2f699a3314fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='782af78cbc734c2c98c23c4148137d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Creating volume c2d9059c-a189-41cc-b733-6571d1c9010a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:48 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a 2147483648 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:49 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a 2147483648 Sep 28 17:08:49 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0738c5f2-4944-4f92-be83-2ebc57bcfe99 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-1112938563: creating Sep 28 17:08:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0738c5f2-4944-4f92-be83-2ebc57bcfe99 tempest-GroupSnapshotsTest-1724518088 None] Group tempest-GroupSnapshotsTest-Group-1112938563: created successfully Sep 28 17:08:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0738c5f2-4944-4f92-be83-2ebc57bcfe99 tempest-GroupSnapshotsTest-1724518088 None] Create group completed successfully. Sep 28 17:08:49 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a 2147483648" returned: 0 in 0.744s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:49 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a Sep 28 17:08:49 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (56571de6-420b-48f9-af3c-68c95446dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8964db8-cc0a-4728-82ef-89e6f3157c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8964db8-cc0a-4728-82ef-89e6f3157c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1397556337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca8cbe5-d169-4456-8c22-8ddeb50f9abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:50Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f90ce6-5789-4f7c-90d7-26870b292640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f90ce6-5789-4f7c-90d7-26870b292640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b68d10-589a-4a7c-bcb4-2a7c440625e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b68d10-589a-4a7c-bcb4-2a7c440625e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca8cbe5-d169-4456-8c22-8ddeb50f9abd', 'volume_name': 'volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1edbfb-3185-4b4a-9a2a-532ef7ce455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1edbfb-3185-4b4a-9a2a-532ef7ce455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee666143-3305-43cc-be2d-69d290e41d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Volume 8ca8cbe5-d169-4456-8c22-8ddeb50f9abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd', 'volume_size': 1} Sep 28 17:08:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:50 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1397556337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca8cbe5-d169-4456-8c22-8ddeb50f9abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0c505fe8cd4d58bd56b9db6b564360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:50Z,use_quota=True,user_id='2d110b51dc254e5488f1a8ddc9d830d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Creating volume 8ca8cbe5-d169-4456-8c22-8ddeb50f9abd {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:50 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d573126-cbf5-4271-a2a8-7935882ed0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d9059c-a189-41cc-b733-6571d1c9010a', 'volume_size': 2}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:50 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd 1073741824 Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40991f6d-4c17-4041-bfe3-f9af8afcd82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:50 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Volume volume-c2d9059c-a189-41cc-b733-6571d1c9010a (c2d9059c-a189-41cc-b733-6571d1c9010a): created successfully Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40991f6d-4c17-4041-bfe3-f9af8afcd82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Flow 'volume_create_manager' (759ea0de-1a13-4040-aa94-028015fbac9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1d2f5b52-827f-4462-ae22-b8ef559cf7ec tempest-VolumesCloneNegativeTest-632896592 None] Created volume successfully. Sep 28 17:08:50 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd 1073741824" returned: 0 in 0.564s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd Sep 28 17:08:50 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" returned: 0 in 0.320s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee666143-3305-43cc-be2d-69d290e41d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc023ef9-ba3d-4564-be59-e528e2f39050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Acquiring lock "cinder-c2d9059c-a189-41cc-b733-6571d1c9010a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Volume volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd (8ca8cbe5-d169-4456-8c22-8ddeb50f9abd): created successfully Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc023ef9-ba3d-4564-be59-e528e2f39050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Flow 'volume_create_manager' (56571de6-420b-48f9-af3c-68c95446dff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "cinder-c2d9059c-a189-41cc-b733-6571d1c9010a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-24417f6d-1938-45f7-9426-1ae0531629bf tempest-VolumesActionsTest-290627148 None] Created volume successfully. Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Acquiring lock "cinder-quobyte-c2d9059c-a189-41cc-b733-6571d1c9010a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "cinder-quobyte-c2d9059c-a189-41cc-b733-6571d1c9010a" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d79203-0d9c-4780-9d71-72d47e253b57]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a Sep 28 17:08:51 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (409396b1-31cb-4e37-b4a4-817f4e2e06c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdeaf3b2-1f89-47f7-bfbb-2ded87ecdd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdeaf3b2-1f89-47f7-bfbb-2ded87ecdd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060132712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95676db-eb7f-4483-b124-ca9ec588c2ee,host='devstack@QuobyteHD#QuobyteHD',id=6d218d80-ae2e-4d56-ab10-b098c153f8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:51Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9ae8ae-183f-4c69-bc8d-87db1abd4024),volume_type_id=3d9ae8ae-183f-4c69-bc8d-87db1abd4024)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7af453-8a2e-4116-afb4-ca0773d3b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7af453-8a2e-4116-afb4-ca0773d3b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18519df9-f5cf-4a9b-9e05-6c4026609604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18519df9-f5cf-4a9b-9e05-6c4026609604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d218d80-ae2e-4d56-ab10-b098c153f8d9', 'volume_name': 'volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4db5792-0081-490c-8689-3b624a29aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4db5792-0081-490c-8689-3b624a29aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db46bf3-a388-4df4-97a6-1f44516cd472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Volume 6d218d80-ae2e-4d56-ab10-b098c153f8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9', 'volume_size': 1} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a95676db-eb7f-4483-b124-ca9ec588c2ee,created_at=2026-09-28T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060132712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95676db-eb7f-4483-b124-ca9ec588c2ee,host='devstack@QuobyteHD#QuobyteHD',id=6d218d80-ae2e-4d56-ab10-b098c153f8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1bc3c2a6b44a6b91f65cc5f5ad1aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:51Z,use_quota=True,user_id='7c4552c2b05f4d769a1e6a7f76e0f3f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9ae8ae-183f-4c69-bc8d-87db1abd4024),volume_type_id=3d9ae8ae-183f-4c69-bc8d-87db1abd4024)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Creating volume 6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:51 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 1073741824 Sep 28 17:08:51 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a" returned: 0 in 0.530s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a Sep 28 17:08:51 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c2d9059c-a189-41cc-b733-6571d1c9010a" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "cinder-quobyte-c2d9059c-a189-41cc-b733-6571d1c9010a" released by "delete_volume" :: held 0.971s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:52 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 1073741824" returned: 0 in 0.688s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 Sep 28 17:08:52 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Created reservations ['e12f5222-f9d5-4e09-9759-6f5d765cc6ab', 'f4000a6a-fb5f-443c-80fd-eb7096d3e638', '62893a25-9671-4704-907d-86d37b946880', '5b314b77-e53c-4937-bcd9-eb65c817dd4c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:52 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:52 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:52 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9" returned: 0 in 0.412s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db46bf3-a388-4df4-97a6-1f44516cd472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04ea967-bc4c-46cb-867b-057dd2e04b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:52 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Volume volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 (6d218d80-ae2e-4d56-ab10-b098c153f8d9): created successfully Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04ea967-bc4c-46cb-867b-057dd2e04b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Flow 'volume_create_manager' (409396b1-31cb-4e37-b4a4-817f4e2e06c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8b1eca47-b29c-46c1-a48b-57569c131688 tempest-GroupSnapshotsTest-1724518088 None] Created volume successfully. Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:52 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.373s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "cinder-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Deleted volume successfully. Sep 28 17:08:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65b887c1-e418-499a-a2d2-b529ba154fbd tempest-VolumesCloneNegativeTest-632896592 None] Lock "cinder-c2d9059c-a189-41cc-b733-6571d1c9010a-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Acquiring lock "cinder-quobyte-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "cinder-quobyte-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c9889-2c61-4173-9b97-d29489cf7dfe]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd Sep 28 17:08:53 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" returned: 0 in 0.411s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd Sep 28 17:08:53 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" returned: 0 in 0.301s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "cinder-quobyte-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd" released by "delete_volume" :: held 0.761s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Created reservations ['5eff92ae-824f-47d8-80a4-71e5992ca468', 'a3f2402d-f8b3-41f1-8993-efc87ed98b60', '3be0a87e-f0b1-4f9a-ba46-c2dab0448766', '0fbba775-3dad-400d-ae3c-eb135d43df58'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:54 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:08:54 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] GroupSnapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: creating. Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Group snapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: creating. {{(pid=87034) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Creating offline snapshot 3d08a456-6788-43f4-855b-59ef8edcdb9c of volume 6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:08:54 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Deleted volume successfully. Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd91a127-d7e6-4b60-8627-172cddb64667]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d47e3ce6-4bf3-403c-b16c-f768ba4b7b58 tempest-VolumesActionsTest-290627148 None] Lock "cinder-8ca8cbe5-d169-4456-8c22-8ddeb50f9abd-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:54 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 Sep 28 17:08:54 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:55 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Flow 'volume_create_manager' (9fa380b8-d347-412e-a034-c63009c4453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413b3c72-65fe-48aa-914e-43a753ccc61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9" returned: 0 in 0.732s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413b3c72-65fe-48aa-914e-43a753ccc61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-922880822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dd0131-7d9d-4d1f-bad0-d106998ae1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a549d4acec4b6e96cf577973676a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:55Z,use_quota=True,user_id='4153eee46a654ea88acb3c6070944653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:55 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c 1G Sep 28 17:08:55 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e07bf-d838-4acb-8b9c-354c3984b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e07bf-d838-4acb-8b9c-354c3984b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6410dd0-777d-4c7a-bead-3eb1a2febb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6410dd0-777d-4c7a-bead-3eb1a2febb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dd0131-7d9d-4d1f-bad0-d106998ae1ea', 'volume_name': 'volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bf5e89-eb69-4abb-8925-1a0670d020a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bf5e89-eb69-4abb-8925-1a0670d020a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e51b8eb-0bd1-4e7f-b92b-013e89c5af62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Volume 57dd0131-7d9d-4d1f-bad0-d106998ae1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea', 'volume_size': 1} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:55 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c 1G" returned: 0 in 0.699s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c Sep 28 17:08:56 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:56 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c" returned: 0 in 0.534s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:56 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c Sep 28 17:08:56 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:56 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c" returned: 0 in 0.322s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:56 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info Sep 28 17:08:56 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info" returned: 0 in 0.389s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:57 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:57 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info Sep 28 17:08:57 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.info" returned: 0 in 0.372s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.208s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-922880822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dd0131-7d9d-4d1f-bad0-d106998ae1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a549d4acec4b6e96cf577973676a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:55Z,use_quota=True,user_id='4153eee46a654ea88acb3c6070944653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Creating volume 57dd0131-7d9d-4d1f-bad0-d106998ae1ea {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:57 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:08:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:57 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea 1073741824 Sep 28 17:08:57 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-afbff872-23e5-49e8-87dc-f23792269b15 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: created successfully Sep 28 17:08:58 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea 1073741824" returned: 0 in 0.756s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=173,cinder:UPDATE=182,cinder:INSERT=49,cinder:DELETE=13 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=151,cinder:UPDATE=210,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:58 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea Sep 28 17:08:58 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:58 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" returned: 0 in 0.346s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e51b8eb-0bd1-4e7f-b92b-013e89c5af62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b253ec-0156-420e-8df4-5cb6a3b9ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Volume volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea (57dd0131-7d9d-4d1f-bad0-d106998ae1ea): created successfully Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b253ec-0156-420e-8df4-5cb6a3b9ca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Flow 'volume_create_manager' (9fa380b8-d347-412e-a034-c63009c4453e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: deleting Sep 28 17:08:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-39766c39-fdcf-4106-842b-0a3a9240b56d tempest-AttachVolumeShelveTestJSON-640873088 None] Created volume successfully. Sep 28 17:08:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: deleting {{(pid=87034) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-3d08a456-6788-43f4-855b-59ef8edcdb9c" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3d08a456-6788-43f4-855b-59ef8edcdb9c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Deleting offline snapshot 3d08a456-6788-43f4-855b-59ef8edcdb9c of volume 6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] snapshot_file for this snap is: volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fb622f-cff8-49f8-b77b-068fc4fa3f8b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c Sep 28 17:08:59 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:59 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c" returned: 0 in 0.726s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[076b823d-d587-498c-ae65-3c93a4f4b669]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Flow 'volume_create_manager' (3342c2e2-807b-42de-8fbe-be1809506802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a1548e-c236-4392-9c06-31d0d23cd1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a1548e-c236-4392-9c06-31d0d23cd1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1471179992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e084ed-1b48-4ef9-9cd6-8c5119ebfad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f74ef56034a46a9add78497b00ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:00Z,use_quota=True,user_id='30c9df61d8c0464587cca37b7c237b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7de690-6ac9-46e9-b875-cae9c6f28881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7de690-6ac9-46e9-b875-cae9c6f28881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1949198-6332-4743-9c7c-e96a740b1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:09:00 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 Sep 28 17:09:00 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1949198-6332-4743-9c7c-e96a740b1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59e084ed-1b48-4ef9-9cd6-8c5119ebfad0', 'volume_name': 'volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a17d38d-0b37-408e-8fb2-350b11f080c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a17d38d-0b37-408e-8fb2-350b11f080c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600777ae-74cd-4bad-9849-49730f9bd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Trying to clone 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:09:00 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9" returned: 0 in 0.659s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:00 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c Sep 28 17:09:00 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:09:01 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:09:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33ece3-2c93-43f2-a30f-7abd53227fe5]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c" returned: 0 in 0.813s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c Sep 28 17:09:01 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD Sep 28 17:09:01 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9.3d08a456-6788-43f4-855b-59ef8edcdb9c" returned: 0 in 0.617s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef is fetched for user 30c9df61d8c0464587cca37b7c237b4a. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-3d08a456-6788-43f4-855b-59ef8edcdb9c" released by "_delete_snapshot" :: held 3.033s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" released by "delete_snapshot" :: held 3.082s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b27a9c-321e-4774-aa9a-873c4fd2c39a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack cinder-volume[87034]: WARNING cinder.quota [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1957278244 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1957278244, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:02 devstack cinder-volume[87034]: WARNING cinder.quota [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1957278244 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1957278244, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['5c883d01-9aa0-4531-819a-c47fbee906c5', 'e92e84aa-e258-45ee-9c0b-043003993c81', 'a5a128f1-4ad7-438e-a0b6-c6edf55ca93d', 'c9bf29cf-87fa-479a-893b-19fd10cfca91'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:02 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD Sep 28 17:09:02 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dd10f5b2-7381-4237-8151-927c13c708e5 tempest-GroupSnapshotsTest-1724518088 None] group_snapshot 69f508c0-3304-4d41-afb1-c32e92721bd7: deleted successfully Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:02 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1471179992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e084ed-1b48-4ef9-9cd6-8c5119ebfad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f74ef56034a46a9add78497b00ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:00Z,use_quota=True,user_id='30c9df61d8c0464587cca37b7c237b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Creating volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:02 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:02 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1073741824 Sep 28 17:09:02 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:03 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.444s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:03 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1073741824" returned: 0 in 0.859s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:03 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 Sep 28 17:09:03 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:04 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceba03c-f487-44f4-b09b-3cdeb7ac1602]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Attempting download of 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b55bbb-753b-4747-b348-2bd8c219f361]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 Sep 28 17:09:04 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo Sep 28 17:09:04 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9" returned: 0 in 0.544s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9 Sep 28 17:09:04 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo" returned: 0 in 0.485s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo Sep 28 17:09:05 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:05 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d218d80-ae2e-4d56-ab10-b098c153f8d9" returned: 0 in 0.360s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Lock "cinder-quobyte-6d218d80-ae2e-4d56-ab10-b098c153f8d9" released by "delete_volume" :: held 1.047s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['fc4e10e5-259a-40c0-9d78-e58e942b5ad7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:05 devstack cinder-volume[87034]: WARNING cinder.quota [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1957278244 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1957278244, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Created reservations ['811c4a9b-e263-446d-a352-152eb889119d', '503ea091-517f-4c44-b63f-779fee3893b1', '82656896-d016-45e7-a586-50556d19e6b0', 'eb391ce4-39f0-4ce6-9f9b-b10174cec70c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:05 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo" returned: 1 in 0.626s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mkmnrpdo' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[42514af6-4934-487f-b6de-682c4db1f1c3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD Sep 28 17:09:05 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:05 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:05 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:09:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 Sep 28 17:09:06 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.342s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9c175854-0814-48e9-9a25-a0961c3d04a8 tempest-GroupSnapshotsTest-1724518088 None] Delete group completed successfully. Sep 28 17:09:09 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" returned: 0 in 3.344s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_c4h_3tr5devstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:09:09 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Converted 112.00 MB image at 33.48 MB/s Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:09 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1G Sep 28 17:09:09 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:09 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 1G" returned: 0 in 0.611s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Downloaded image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef for user 30c9df61d8c0464587cca37b7c237b4a is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Marking volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Copying metadata from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef to 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:09:09 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Creating volume glance metadata for volume 59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 backed by image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:09:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600777ae-74cd-4bad-9849-49730f9bd181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b24523-5636-4182-85f3-94a59d193a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Volume volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 (59e084ed-1b48-4ef9-9cd6-8c5119ebfad0): created successfully Sep 28 17:09:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b24523-5636-4182-85f3-94a59d193a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Flow 'volume_create_manager' (3342c2e2-807b-42de-8fbe-be1809506802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-62656298-1928-4d9a-acba-0b24393536d3 tempest-VolumesExtendTest-1039094709 None] Created volume successfully. Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[744af79f-8c2c-4510-9e02-6a9c8fea59f9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:11 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 Sep 28 17:09:11 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:11 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" returned: 0 in 0.660s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 2G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 2G" returned: 0 in 0.170s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.905s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-29a073ee-a4d2-4248-905d-f9ec06439320 tempest-VolumesExtendTest-1039094709 None] Extend volume completed successfully. Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "cinder-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-quobyte-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd9cca5-eddd-4fa8-9749-f967d3f8b6d0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:13 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 Sep 28 17:09:13 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:14 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" returned: 0 in 0.675s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0 Sep 28 17:09:14 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:14 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" returned: 0 in 0.455s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0" released by "delete_volume" :: held 1.215s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Created reservations ['f312b6b3-61c1-4586-b8b0-fb9dd300205f', 'b4281ea6-3f4e-4834-b7fc-5c93c815f155', '2fd0ba24-d427-4743-91fc-ce5526b1617a', '5b262ba7-cbf8-4505-9c86-278eac7417dc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:15 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:15 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-ebd79937-3db9-4d2e-873f-6bdc832f3b31 req-7d113699-c813-4907-89fd-86ee7760d897 tempest-AttachVolumeShelveTestJSON-640873088 None] No connector for attachment 6afe75c4-1be2-451e-92e3-7ba7f01a82a0; skipping storage backend terminate_connection call. {{(pid=87034) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-ebd79937-3db9-4d2e-873f-6bdc832f3b31 req-7d113699-c813-4907-89fd-86ee7760d897 tempest-AttachVolumeShelveTestJSON-640873088 None] Deleting attachment 6afe75c4-1be2-451e-92e3-7ba7f01a82a0. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:15 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.352s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Deleted volume successfully. Sep 28 17:09:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6099a7f9-fe01-4478-98c3-249a7567a75f tempest-VolumesExtendTest-1039094709 None] Lock "cinder-59e084ed-1b48-4ef9-9cd6-8c5119ebfad0-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Flow 'volume_create_manager' (13aa4a86-bedb-48aa-bc43-76a7db25a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209b5ce-efa4-4c44-b66a-40d02923de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209b5ce-efa4-4c44-b66a-40d02923de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-663306937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364953f6-1b72-4904-ab86-c91e9422c473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f74ef56034a46a9add78497b00ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:17Z,use_quota=True,user_id='30c9df61d8c0464587cca37b7c237b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e6dfb-a906-4cbd-a2d2-abb7d460c9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299e6dfb-a906-4cbd-a2d2-abb7d460c9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3250a2d3-c614-4d56-8293-0e17bcf84d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3250a2d3-c614-4d56-8293-0e17bcf84d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364953f6-1b72-4904-ab86-c91e9422c473', 'volume_name': 'volume-364953f6-1b72-4904-ab86-c91e9422c473', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1921a94-878a-45bf-8eb9-1f60f7a0173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1921a94-878a-45bf-8eb9-1f60f7a0173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a05e3f-32de-4642-afb9-067b4fe34228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Volume 364953f6-1b72-4904-ab86-c91e9422c473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364953f6-1b72-4904-ab86-c91e9422c473', 'volume_size': 1} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-663306937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364953f6-1b72-4904-ab86-c91e9422c473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f74ef56034a46a9add78497b00ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:17Z,use_quota=True,user_id='30c9df61d8c0464587cca37b7c237b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Creating volume 364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:16 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 1073741824 Sep 28 17:09:16 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 1073741824" returned: 0 in 0.621s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:17 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a05e3f-32de-4642-afb9-067b4fe34228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364953f6-1b72-4904-ab86-c91e9422c473', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef08065-51d4-42da-9a00-110d3548db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Volume volume-364953f6-1b72-4904-ab86-c91e9422c473 (364953f6-1b72-4904-ab86-c91e9422c473): created successfully Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef08065-51d4-42da-9a00-110d3548db4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Flow 'volume_create_manager' (13aa4a86-bedb-48aa-bc43-76a7db25a74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c928fe0e-4a56-433c-8f2b-5f0608811707 tempest-VolumesExtendTest-1039094709 None] Created volume successfully. Sep 28 17:09:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Creating offline snapshot d6dc782e-d4ee-4121-87cd-d22a4802d87f of volume 364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1acd19-8f39-49fa-a746-23cbcdbae801]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:19 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.863s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f 1G Sep 28 17:09:20 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Flow 'volume_create_manager' (c71be47a-708f-4528-b334-df746225a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af692ba-380c-426f-b225-47e70afa2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af692ba-380c-426f-b225-47e70afa2106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1743404070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb2284e-563f-43cf-b805-80b95fb70083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80599e3658f4a3e94286dcd3e8edab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:20Z,use_quota=True,user_id='d0f6abe4ea844db091180afa662b9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec7774-02c8-4d32-a713-41bf2cda5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec7774-02c8-4d32-a713-41bf2cda5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da1cec-ac2f-4e2b-bbf0-a54531d38626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da1cec-ac2f-4e2b-bbf0-a54531d38626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb2284e-563f-43cf-b805-80b95fb70083', 'volume_name': 'volume-1eb2284e-563f-43cf-b805-80b95fb70083', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57167d69-0cf8-43fb-ac72-cf641d0c1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57167d69-0cf8-43fb-ac72-cf641d0c1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90867266-d109-4269-910f-11f37f304dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Volume 1eb2284e-563f-43cf-b805-80b95fb70083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb2284e-563f-43cf-b805-80b95fb70083', 'volume_size': 1} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:20 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f 1G" returned: 0 in 0.740s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364953f6-1b72-4904-ab86-c91e9422c473 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364953f6-1b72-4904-ab86-c91e9422c473 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f Sep 28 17:09:20 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364953f6-1b72-4904-ab86-c91e9422c473 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f" returned: 0 in 0.517s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f is being set with open permissions: ugo+rw Sep 28 17:09:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:21 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f Sep 28 17:09:21 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:21 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info Sep 28 17:09:21 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:22 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info" returned: 0 in 0.379s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:22 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info is being set with open permissions: ugo+rw Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:22 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info Sep 28 17:09:22 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:22 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.info" returned: 0 in 0.538s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.569s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1743404070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb2284e-563f-43cf-b805-80b95fb70083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80599e3658f4a3e94286dcd3e8edab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:20Z,use_quota=True,user_id='d0f6abe4ea844db091180afa662b9ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Creating volume 1eb2284e-563f-43cf-b805-80b95fb70083 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:22 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:22 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 1073741824 Sep 28 17:09:22 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d3203dfb-1df6-49ac-8fe0-3b29b34cea95 tempest-VolumesExtendTest-1039094709 None] Create snapshot completed successfully Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Flow 'volume_create_manager' (95cdf025-9131-48ce-8484-51ed2a0af5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060caede-78d1-4f10-93ca-d3395841c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060caede-78d1-4f10-93ca-d3395841c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2090827140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09645d9-a6c6-47ee-9957-81f79d17e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98879be84a1404c9a6f8f13fc79be51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:23Z,use_quota=True,user_id='d6055bb1d77446bcbf6c738ead34f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dad14-0de4-4d56-8c35-836e29d44a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92dad14-0de4-4d56-8c35-836e29d44a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20f8fb6-3013-418d-a636-688d49eec51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20f8fb6-3013-418d-a636-688d49eec51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09645d9-a6c6-47ee-9957-81f79d17e7d6', 'volume_name': 'volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4831c4fb-83e5-4d08-92b2-7e14d116ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4831c4fb-83e5-4d08-92b2-7e14d116ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e76895c-55bb-4ddd-9980-a7d458c9beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Volume f09645d9-a6c6-47ee-9957-81f79d17e7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6', 'volume_size': 1} Sep 28 17:09:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:23 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 1073741824" returned: 0 in 0.771s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:23 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 Sep 28 17:09:23 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:23 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083" returned: 0 in 0.420s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.975s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2090827140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09645d9-a6c6-47ee-9957-81f79d17e7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98879be84a1404c9a6f8f13fc79be51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:23Z,use_quota=True,user_id='d6055bb1d77446bcbf6c738ead34f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Creating volume f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:23 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90867266-d109-4269-910f-11f37f304dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb2284e-563f-43cf-b805-80b95fb70083', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:24 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 1073741824 Sep 28 17:09:24 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317d519-a71d-44a6-938f-8bd950af18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Volume volume-1eb2284e-563f-43cf-b805-80b95fb70083 (1eb2284e-563f-43cf-b805-80b95fb70083): created successfully Sep 28 17:09:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5317d519-a71d-44a6-938f-8bd950af18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Flow 'volume_create_manager' (c71be47a-708f-4528-b334-df746225a00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ae56e16a-5259-4645-95bf-a81560c4a210 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Created volume successfully. Sep 28 17:09:24 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 1073741824" returned: 0 in 0.699s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:24 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 Sep 28 17:09:24 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:25 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6" returned: 0 in 0.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.414s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e76895c-55bb-4ddd-9980-a7d458c9beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833314d-25a0-424f-8b6d-fcaf9ec4c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f52d99a-6c70-4186-8015-454fe60834e4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Volume volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 (f09645d9-a6c6-47ee-9957-81f79d17e7d6): created successfully Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833314d-25a0-424f-8b6d-fcaf9ec4c227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Flow 'volume_create_manager' (95cdf025-9131-48ce-8484-51ed2a0af5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-45015c02-3810-493a-b845-12fb18bfce9e tempest-SnapshotMetadataTestJSON-541876338 None] Created volume successfully. Sep 28 17:09:25 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:25 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:25 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.558s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f 2G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f 2G" returned: 0 in 0.242s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.876s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4462771a-5e77-4613-9cf4-5df3e1640d16 tempest-VolumesExtendTest-1039094709 None] Extend volume completed successfully. Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Acquiring lock "cinder-1eb2284e-563f-43cf-b805-80b95fb70083-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "cinder-1eb2284e-563f-43cf-b805-80b95fb70083-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Acquiring lock "cinder-quobyte-1eb2284e-563f-43cf-b805-80b95fb70083" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "cinder-quobyte-1eb2284e-563f-43cf-b805-80b95fb70083" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a2139e-026b-4473-8920-cc4eb164fe5c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Creating offline snapshot 380cf2e8-f482-4105-9cbe-0b471f5e9926 of volume f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:26 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 Sep 28 17:09:26 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fcadf1-52e4-46f7-a9df-8b39391d2b89]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 Sep 28 17:09:26 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:26 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083" returned: 0 in 0.609s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:26 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083 Sep 28 17:09:26 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6" returned: 0 in 0.556s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 1G Sep 28 17:09:27 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-d6dc782e-d4ee-4121-87cd-d22a4802d87f-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-d6dc782e-d4ee-4121-87cd-d22a4802d87f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-quobyte-d6dc782e-d4ee-4121-87cd-d22a4802d87f" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-d6dc782e-d4ee-4121-87cd-d22a4802d87f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Deleting offline snapshot d6dc782e-d4ee-4121-87cd-d22a4802d87f of volume 364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] snapshot_file for this snap is: volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:27 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1eb2284e-563f-43cf-b805-80b95fb70083" returned: 0 in 0.383s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9b0dad-b7cd-4a50-9c90-58031bc9673a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "cinder-quobyte-1eb2284e-563f-43cf-b805-80b95fb70083" released by "delete_volume" :: held 1.094s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Created reservations ['2fe1343c-0fcc-4d0f-bc20-b7c6223f96c1', '629692a4-332c-4cb1-a0f2-b24f84474967', '190ab864-a43b-43a8-8c2f-7f72e3d5f115', '93d1fea2-fbc0-4973-b3d3-eedb2118862d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:27 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f Sep 28 17:09:27 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:27 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 1G" returned: 0 in 0.684s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:27 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 Sep 28 17:09:27 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:27 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f" returned: 0 in 0.547s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364953f6-1b72-4904-ab86-c91e9422c473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:27 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.330s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Deleted volume successfully. Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8967e-0b16-479e-a0c8-d06fba9490da]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-fffe3241-95de-4fc1-b575-f8093ec1d1b0 tempest-VolumeQuotasNegativeTestJSON-325909288 None] Lock "cinder-1eb2284e-563f-43cf-b805-80b95fb70083-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:28 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:28 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:28 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926" returned: 0 in 0.603s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:28 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 is being set with open permissions: ugo+rw Sep 28 17:09:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:28 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 Sep 28 17:09:28 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:28 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.928s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:28 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f Sep 28 17:09:28 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:29 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926" returned: 0 in 0.736s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info Sep 28 17:09:29 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:29 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info" returned: 0 in 0.436s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:29 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info is being set with open permissions: ugo+rw Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info Sep 28 17:09:29 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:29 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f" returned: 0 in 0.837s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f Sep 28 17:09:29 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.info" returned: 0 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.607s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b2416d8a-cb44-47d6-ad70-eb4c7da29ad4 tempest-SnapshotMetadataTestJSON-541876338 None] Create snapshot completed successfully Sep 28 17:09:30 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473.d6dc782e-d4ee-4121-87cd-d22a4802d87f" returned: 0 in 0.434s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-d6dc782e-d4ee-4121-87cd-d22a4802d87f" released by "_delete_snapshot" :: held 2.971s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" released by "delete_snapshot" :: held 3.003s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Created reservations ['f2f030b6-fddf-4fe1-9e2c-3ae53a5c1507', '006a9089-ca19-4906-97ef-c1675a8f762f', '8348169d-204f-4116-a49e-3f1af4a1deb9', '56ec6af6-ab22-4275-9ba1-f9644a71c845'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Delete snapshot completed successfully. Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a785d38c-0d7d-43a6-9be3-50edd3e317ca tempest-VolumesExtendTest-1039094709 None] Lock "cinder-d6dc782e-d4ee-4121-87cd-d22a4802d87f-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-364953f6-1b72-4904-ab86-c91e9422c473-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "cinder-364953f6-1b72-4904-ab86-c91e9422c473-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da7b11c-c48c-40e4-a831-99a4e1c0d58d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:30 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:31 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.804s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:31 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473 Sep 28 17:09:31 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-364953f6-1b72-4904-ab86-c91e9422c473" returned: 0 in 0.680s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "cinder-quobyte-364953f6-1b72-4904-ab86-c91e9422c473" released by "delete_volume" :: held 1.601s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Created reservations ['1da403e7-edf0-445f-8161-bff487c048d1', 'f2f1ebe6-e588-42dc-bc06-558daa92da65', '19c032a1-54bd-4d70-bcba-42205c2817f3', 'eaecd1c5-77d1-4953-bc60-7e041de7f94f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:32 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "cinder-380cf2e8-f482-4105-9cbe-0b471f5e9926-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-380cf2e8-f482-4105-9cbe-0b471f5e9926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "cinder-quobyte-380cf2e8-f482-4105-9cbe-0b471f5e9926" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-380cf2e8-f482-4105-9cbe-0b471f5e9926" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Deleting offline snapshot 380cf2e8-f482-4105-9cbe-0b471f5e9926 of volume f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] snapshot_file for this snap is: volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47aef7-eb27-4544-823c-2e41e7e8d1a9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 1.009s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:33 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 Sep 28 17:09:33 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Deleted volume successfully. Sep 28 17:09:33 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-957d7a0e-cccd-4701-9ee7-62f7cd8a2406 tempest-VolumesExtendTest-1039094709 None] Lock "cinder-364953f6-1b72-4904-ab86-c91e9422c473-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:34 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926" returned: 0 in 0.749s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[829beef3-c58f-488f-b32e-b659b88fc6e2]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:34 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 Sep 28 17:09:34 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:35 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6" returned: 0 in 0.786s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:35 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 Sep 28 17:09:35 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:35 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926" returned: 0 in 0.639s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:35 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926 Sep 28 17:09:35 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:36 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6.380cf2e8-f482-4105-9cbe-0b471f5e9926" returned: 0 in 0.485s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-380cf2e8-f482-4105-9cbe-0b471f5e9926" released by "_delete_snapshot" :: held 2.960s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" released by "delete_snapshot" :: held 3.058s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:36 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Created reservations ['5ab4b56d-380b-48b2-b4b6-44a0f71488f7', '9dd26295-09f5-4ce0-9cdf-e733db5d0f36', '3a475aef-1a71-4054-b355-364a65d5be1f', 'b429daa3-cb10-465d-8cb2-6d76dae0e88e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Delete snapshot completed successfully. Sep 28 17:09:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-82a35793-d2db-4bfe-8400-8e1764192559 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-380cf2e8-f482-4105-9cbe-0b471f5e9926-delete_snapshot" released by "delete_snapshot" :: held 3.401s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "cinder-f09645d9-a6c6-47ee-9957-81f79d17e7d6-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-f09645d9-a6c6-47ee-9957-81f79d17e7d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56c4c6-8593-4258-b179-6fca8fa93a62]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:38 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 Sep 28 17:09:38 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:38 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6" returned: 0 in 0.543s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:38 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6 Sep 28 17:09:38 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:38 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f09645d9-a6c6-47ee-9957-81f79d17e7d6" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-quobyte-f09645d9-a6c6-47ee-9957-81f79d17e7d6" released by "delete_volume" :: held 1.090s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Created reservations ['33b8cf40-cfc3-4f4a-97c8-a2ebf5015aca', 'e40fafb2-ea62-4952-bc71-6c6b355bcc69', '23a38197-7f6c-434e-abca-71c28c0491ab', '1c8ba8fd-f4d4-464e-92fd-d118f2a1a888'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:39 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:39 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:39 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.551s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Deleted volume successfully. Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-237021b7-b6fb-4c77-a741-ddfc4c099c23 tempest-SnapshotMetadataTestJSON-541876338 None] Lock "cinder-f09645d9-a6c6-47ee-9957-81f79d17e7d6-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (813e10cf-6334-4076-91ed-3ae199a9c81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fa93c-b82e-496e-88e1-6f271ad8d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fa93c-b82e-496e-88e1-6f271ad8d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1217190668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b322d-76fe-4867-b0ff-9a9e1372ee80,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:40Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f016ab-179d-4151-9b04-242c4dd3b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f016ab-179d-4151-9b04-242c4dd3b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ff42bc-8d2b-49a3-b54d-12122177f5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ff42bc-8d2b-49a3-b54d-12122177f5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80b322d-76fe-4867-b0ff-9a9e1372ee80', 'volume_name': 'volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c88810-b638-4675-a600-5efa279457d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c88810-b638-4675-a600-5efa279457d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c4e32d-79db-42bc-8091-d9d88535eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Volume d80b322d-76fe-4867-b0ff-9a9e1372ee80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80', 'volume_size': 1} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1217190668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80b322d-76fe-4867-b0ff-9a9e1372ee80,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:40Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Creating volume d80b322d-76fe-4867-b0ff-9a9e1372ee80 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:40 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 1073741824 Sep 28 17:09:40 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 1073741824" returned: 0 in 0.701s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:40 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 Sep 28 17:09:40 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:41 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80" returned: 0 in 0.518s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c4e32d-79db-42bc-8091-d9d88535eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34705a08-4708-4117-a786-f704c2420845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Volume volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 (d80b322d-76fe-4867-b0ff-9a9e1372ee80): created successfully Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34705a08-4708-4117-a786-f704c2420845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (813e10cf-6334-4076-91ed-3ae199a9c81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bb1927cc-54ee-4cbd-b3ea-9086184db76d tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Flow 'volume_create_manager' (e557a578-ecbf-4adf-a081-c4a2db5ee910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f37f755-ac2e-42fb-b5e6-0d0496ddd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f37f755-ac2e-42fb-b5e6-0d0496ddd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-839358099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a71ad8-2eb8-4d20-bcf0-80f2f7585adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9e70ba42bb4424a2621e6e37f2a78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:42Z,use_quota=True,user_id='cee42c4c731b4ab4a61ac87978b8f183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a769b-0fc9-4df7-96f7-5c7ade3b2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3a769b-0fc9-4df7-96f7-5c7ade3b2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cbdb77-e2af-4b99-af9b-fc5499d27997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cbdb77-e2af-4b99-af9b-fc5499d27997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a71ad8-2eb8-4d20-bcf0-80f2f7585adb', 'volume_name': 'volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010e0bd1-01e2-4129-8884-1f7413a2eb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010e0bd1-01e2-4129-8884-1f7413a2eb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8339fda-106f-418b-a1e8-cea02cb8771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Volume 28a71ad8-2eb8-4d20-bcf0-80f2f7585adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb', 'volume_size': 1} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-839358099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a71ad8-2eb8-4d20-bcf0-80f2f7585adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9e70ba42bb4424a2621e6e37f2a78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:42Z,use_quota=True,user_id='cee42c4c731b4ab4a61ac87978b8f183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Creating volume 28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:42 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:42 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb 1073741824 Sep 28 17:09:42 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:42 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb 1073741824" returned: 0 in 0.852s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:42 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb Sep 28 17:09:42 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:43 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" returned: 0 in 0.443s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8339fda-106f-418b-a1e8-cea02cb8771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f473fe33-96cf-4257-aba3-c9921c9065a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Volume volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb (28a71ad8-2eb8-4d20-bcf0-80f2f7585adb): created successfully Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f473fe33-96cf-4257-aba3-c9921c9065a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Flow 'volume_create_manager' (e557a578-ecbf-4adf-a081-c4a2db5ee910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-05530141-0855-47e5-a0fa-50e779cd4b9b tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Created volume successfully. Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (50082ee2-79e0-440c-875b-6f3310349b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20ab7b9-5816-4004-8d85-0240e227944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20ab7b9-5816-4004-8d85-0240e227944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1207218349',display_name='tempest-VolumesGetTest-Volume-1982940413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66188608-be94-4056-a740-cd11debcee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:44Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f2b6eb-a49a-43c0-aca8-59cf1656dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f2b6eb-a49a-43c0-aca8-59cf1656dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbb38ff-7f29-4d25-8dc5-fea52d8a138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbb38ff-7f29-4d25-8dc5-fea52d8a138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66188608-be94-4056-a740-cd11debcee48', 'volume_name': 'volume-66188608-be94-4056-a740-cd11debcee48', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f33da1-7920-46ae-a789-5681f1497d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f33da1-7920-46ae-a789-5681f1497d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af948b23-42d2-4713-b871-145d205747a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Volume 66188608-be94-4056-a740-cd11debcee48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66188608-be94-4056-a740-cd11debcee48', 'volume_size': 1} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1207218349',display_name='tempest-VolumesGetTest-Volume-1982940413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66188608-be94-4056-a740-cd11debcee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:44Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Creating volume 66188608-be94-4056-a740-cd11debcee48 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:44 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:44 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 1073741824 Sep 28 17:09:44 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:44 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 1073741824" returned: 0 in 0.812s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:44 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 Sep 28 17:09:44 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:45 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48" returned: 0 in 0.401s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.724s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af948b23-42d2-4713-b871-145d205747a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66188608-be94-4056-a740-cd11debcee48', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4db933-1ad7-49e3-bd83-a5609a822791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Creating offline snapshot 9cab12f8-8a42-424e-9ee5-8dd6ac171c9e of volume 28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Volume volume-66188608-be94-4056-a740-cd11debcee48 (66188608-be94-4056-a740-cd11debcee48): created successfully Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4db933-1ad7-49e3-bd83-a5609a822791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (50082ee2-79e0-440c-875b-6f3310349b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[48edf88a-775e-420f-9c3a-0ebb4db3f7ab]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-94a58a2a-301a-4a1b-bdcf-af2ae6ca3498 tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:09:45 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb Sep 28 17:09:45 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" returned: 0 in 0.687s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e 1G Sep 28 17:09:46 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-66188608-be94-4056-a740-cd11debcee48-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "cinder-66188608-be94-4056-a740-cd11debcee48-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-66188608-be94-4056-a740-cd11debcee48" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-66188608-be94-4056-a740-cd11debcee48" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeb3f7d-8376-4e55-9708-293bbe597af8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 Sep 28 17:09:46 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e 1G" returned: 0 in 0.672s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e Sep 28 17:09:46 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (b0ca2fd2-2adf-4139-a90b-bba49c6f5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f41a5-a806-4056-93ca-78dd3aa37c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f41a5-a806-4056-93ca-78dd3aa37c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092761090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658091fe-42e2-4614-8eb3-1d068fdbbcba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0c5d934bae4832b2fcd36a5d013dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:47Z,use_quota=True,user_id='1b6a406efb40424ea577b1aeb2b5f9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8179f5-81ba-454c-802a-aa6b3308e478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8179f5-81ba-454c-802a-aa6b3308e478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ed741f-5214-44c6-92b8-a746e9deacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ed741f-5214-44c6-92b8-a746e9deacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658091fe-42e2-4614-8eb3-1d068fdbbcba', 'volume_name': 'volume-658091fe-42e2-4614-8eb3-1d068fdbbcba', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d65f121-84aa-47f5-a8d4-41597bbc483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d65f121-84aa-47f5-a8d4-41597bbc483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aec0f7-f64e-4931-9164-67420012cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Volume 658091fe-42e2-4614-8eb3-1d068fdbbcba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658091fe-42e2-4614-8eb3-1d068fdbbcba', 'volume_size': 1} Sep 28 17:09:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:47 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48" returned: 0 in 0.576s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48 Sep 28 17:09:47 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" returned: 0 in 0.385s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e is being set with open permissions: ugo+rw Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e Sep 28 17:09:47 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-66188608-be94-4056-a740-cd11debcee48" returned: 0 in 0.379s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-66188608-be94-4056-a740-cd11debcee48" released by "delete_volume" :: held 1.044s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Created reservations ['8873788a-df6c-49b5-bd8d-02f529ba5c7c', '2c1c0d94-eb64-4d51-8c53-c67f55bec2d8', '6ae134e2-ada3-4d63-be2e-14df36baffb9', 'ab7a0c92-06e2-4f95-9427-5551ef6d8dd7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:47 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" returned: 0 in 0.433s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info Sep 28 17:09:47 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:09:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ddc5dccf-a23a-4f56-b758-f7ae69d70de3 tempest-VolumesGetTest-927428743 None] Lock "cinder-66188608-be94-4056-a740-cd11debcee48-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:48 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info" returned: 0 in 0.350s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:48 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info is being set with open permissions: ugo+rw Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:48 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info Sep 28 17:09:48 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:48 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.info" returned: 0 in 0.279s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.999s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092761090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658091fe-42e2-4614-8eb3-1d068fdbbcba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0c5d934bae4832b2fcd36a5d013dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:47Z,use_quota=True,user_id='1b6a406efb40424ea577b1aeb2b5f9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Creating volume 658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:48 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:48 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba 1073741824 Sep 28 17:09:48 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-36ecffce-1d0b-405a-9ef0-5faf8b8301ed tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Create snapshot completed successfully Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-d80b322d-76fe-4867-b0ff-9a9e1372ee80-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "cinder-d80b322d-76fe-4867-b0ff-9a9e1372ee80-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-d80b322d-76fe-4867-b0ff-9a9e1372ee80" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-d80b322d-76fe-4867-b0ff-9a9e1372ee80" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5aa00-b3c9-4a94-bbce-b19794307692]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:48 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 Sep 28 17:09:48 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba 1073741824" returned: 0 in 0.658s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:09:49 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80" returned: 0 in 0.530s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80 Sep 28 17:09:49 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "cinder-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 0.418s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aec0f7-f64e-4931-9164-67420012cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658091fe-42e2-4614-8eb3-1d068fdbbcba', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0102850-c258-4fb4-9c79-7f85c08ceef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "cinder-quobyte-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Volume volume-658091fe-42e2-4614-8eb3-1d068fdbbcba (658091fe-42e2-4614-8eb3-1d068fdbbcba): created successfully Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0102850-c258-4fb4-9c79-7f85c08ceef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (b0ca2fd2-2adf-4139-a90b-bba49c6f5097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Deleting offline snapshot 9cab12f8-8a42-424e-9ee5-8dd6ac171c9e of volume 28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] snapshot_file for this snap is: volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-25e13c99-3461-4e15-83ab-61ea461129bb tempest-VolumesDeleteCascade-382344314 None] Created volume successfully. Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36be7f-6afd-41c5-9b5c-728492000935]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d80b322d-76fe-4867-b0ff-9a9e1372ee80" returned: 0 in 0.379s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-d80b322d-76fe-4867-b0ff-9a9e1372ee80" released by "delete_volume" :: held 0.971s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Created reservations ['a77accaa-b6a1-44e0-ab3c-8f002897b884', '764e6912-d3c4-4422-8105-c1e2c826a777', '3e16aabf-de00-4dc3-b5bd-cbab2dc1fe5d', '3a33ef5d-c561-45d1-95ac-d9da0af84612'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:49 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e Sep 28 17:09:49 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:49 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" returned: 0 in 0.598s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:50 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.442s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[37813f00-e42c-4584-87bc-2b9e75f399e6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-633b3211-fc88-4987-8a90-095f8a6e120e tempest-VolumesGetTest-927428743 None] Lock "cinder-d80b322d-76fe-4867-b0ff-9a9e1372ee80-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Creating offline snapshot 3bb8383b-8e38-48b4-8fab-bb5448b7a533 of volume 658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b41312-0d49-46e4-a7ab-427b4795751b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb Sep 28 17:09:50 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:09:50 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" returned: 0 in 0.546s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 0.450s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e Sep 28 17:09:50 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 1G Sep 28 17:09:50 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" returned: 0 in 0.496s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:51 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e Sep 28 17:09:51 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:51 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 1G" returned: 0 in 0.622s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:51 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:09:51 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (1da87506-6af2-4f2a-bd02-920eb53083f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228744dc-15cf-4a06-868d-96704bea1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228744dc-15cf-4a06-868d-96704bea1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883383056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c1dda1-c812-4aa3-bbf3-8a593c544129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:52Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf20374-01e1-47c4-817d-7a15bcc0d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf20374-01e1-47c4-817d-7a15bcc0d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf11eb1-b1ca-4a9c-a30e-adf034fcdbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf11eb1-b1ca-4a9c-a30e-adf034fcdbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c1dda1-c812-4aa3-bbf3-8a593c544129', 'volume_name': 'volume-72c1dda1-c812-4aa3-bbf3-8a593c544129', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36d30ff-c10f-44e0-adc7-21a079a169bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36d30ff-c10f-44e0-adc7-21a079a169bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b476128-6e90-4919-94e5-175e8b7720eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Volume 72c1dda1-c812-4aa3-bbf3-8a593c544129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c1dda1-c812-4aa3-bbf3-8a593c544129', 'volume_size': 1} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:51 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb.9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" returned: 0 in 0.342s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e" released by "_delete_snapshot" :: held 2.191s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" released by "delete_snapshot" :: held 2.245s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Created reservations ['ee53ef08-1704-4dda-8242-ce1ea5ca165f', '85a6e8d3-fa6a-4104-b77e-5590e48c5723', 'd98b1890-cab5-4102-869b-91923b1bbb7f', '33db93e0-9570-4807-ad75-00e06a3e9372'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:51 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:51 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 is being set with open permissions: ugo+rw Sep 28 17:09:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:51 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:09:51 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Delete snapshot completed successfully. Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4dae116e-45f0-44e3-8ebf-064a25b219c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-9cab12f8-8a42-424e-9ee5-8dd6ac171c9e-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:52 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.310s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:52 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info Sep 28 17:09:52 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:52 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info" returned: 0 in 0.323s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:52 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info is being set with open permissions: ugo+rw Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:52 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info Sep 28 17:09:52 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "cinder-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c92605-6607-4e71-a11c-664845c9408a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.info" returned: 0 in 0.389s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883383056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c1dda1-c812-4aa3-bbf3-8a593c544129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:52Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Creating volume 72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:53 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 1073741824 Sep 28 17:09:53 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0af0d12d-f3c4-428c-b015-3c2b4cb8e714 tempest-VolumesDeleteCascade-382344314 None] Create snapshot completed successfully Sep 28 17:09:53 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb Sep 28 17:09:53 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" returned: 0 in 0.631s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb Sep 28 17:09:53 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 1073741824" returned: 0 in 0.694s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:09:53 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:54 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" returned: 0 in 0.431s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-quobyte-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb" released by "delete_volume" :: held 1.164s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Created reservations ['a52dfbed-a7bf-43c0-a6a1-63e15cea8920', '1b218dce-a672-4dd6-8577-504f399df4b1', 'fa31371b-e8fb-4af0-afa1-05c3d5492f8f', '965e9c99-812e-4370-8429-31c1f54df433'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:54 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.419s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.326s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b476128-6e90-4919-94e5-175e8b7720eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c1dda1-c812-4aa3-bbf3-8a593c544129', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989500e6-4b1d-4e27-b7de-b04ac77963ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Creating offline snapshot d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 of volume 658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e78fa-5f48-4526-98dc-5ff75a054b25]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Volume volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 (72c1dda1-c812-4aa3-bbf3-8a593c544129): created successfully Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989500e6-4b1d-4e27-b7de-b04ac77963ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (1da87506-6af2-4f2a-bd02-920eb53083f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:54 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:09:54 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ec5350e0-283d-40d4-8afd-272b92501c27 tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:09:54 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:09:54 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.397s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Deleted volume successfully. Sep 28 17:09:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ac67f3a3-23c7-426c-be4a-b108cd531ef3 tempest-VolumeSnapshotQuotasNegativeTestJSON-243412981 None] Lock "cinder-28a71ad8-2eb8-4d20-bcf0-80f2f7585adb-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:55 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.599s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658091fe-42e2-4614-8eb3-1d068fdbbcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:55 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 1G Sep 28 17:09:55 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:55 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 1G" returned: 0 in 0.701s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:55 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:09:55 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (665faf07-82f1-4660-9b0c-39973ab2ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f77ee6-f733-4357-931d-5836a63f4782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f77ee6-f733-4357-931d-5836a63f4782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-521732688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad532d62-888b-444c-9ee2-40e96f33bdb8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=72c1dda1-c812-4aa3-bbf3-8a593c544129,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:56Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e953c49d-3844-4cdc-b06f-fcb3c42ef439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e953c49d-3844-4cdc-b06f-fcb3c42ef439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75e6302-55b1-4d92-aba6-f6c73c0e30ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75e6302-55b1-4d92-aba6-f6c73c0e30ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ad532d62-888b-444c-9ee2-40e96f33bdb8', 'volume_name': 'volume-ad532d62-888b-444c-9ee2-40e96f33bdb8', 'volume_size': 1, 'source_volid': '72c1dda1-c812-4aa3-bbf3-8a593c544129', 'source_volstatus': 'available'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6b0736-7ff8-4bdb-96ef-4dec0f78d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6b0736-7ff8-4bdb-96ef-4dec0f78d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5350a5b-1bfb-408f-9a74-cddb563a0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Volume ad532d62-888b-444c-9ee2-40e96f33bdb8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ad532d62-888b-444c-9ee2-40e96f33bdb8', 'volume_size': 1, 'source_volid': '72c1dda1-c812-4aa3-bbf3-8a593c544129', 'source_volstatus': 'available'} Sep 28 17:09:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:56 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 0.382s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:56 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 is being set with open permissions: ugo+rw Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:56 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:09:56 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:56 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 0.348s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.676s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:56 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Cloning volume 72c1dda1-c812-4aa3-bbf3-8a593c544129 to volume ad532d62-888b-444c-9ee2-40e96f33bdb8 Sep 28 17:09:56 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dd52bf30-7fd2-48b5-979c-d389ed4f9e8d tempest-VolumesDeleteCascade-382344314 None] Create snapshot completed successfully Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Creating offline snapshot 6f2f1435-3d65-463d-a226-7d20b848ed85 of volume 72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e55d43-05fc-44b6-aa8b-49b2e3a9f7fa]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:56 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:09:56 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:57 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.662s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-658091fe-42e2-4614-8eb3-1d068fdbbcba-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 1G Sep 28 17:09:57 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-658091fe-42e2-4614-8eb3-1d068fdbbcba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Performing cascade delete. {{(pid=87034) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-3bb8383b-8e38-48b4-8fab-bb5448b7a533-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-3bb8383b-8e38-48b4-8fab-bb5448b7a533-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-3bb8383b-8e38-48b4-8fab-bb5448b7a533" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3bb8383b-8e38-48b4-8fab-bb5448b7a533" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Deleting offline snapshot 3bb8383b-8e38-48b4-8fab-bb5448b7a533 of volume 658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] snapshot_file for this snap is: volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab7d40-ad27-4be3-91ab-5866b39fdc86]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:57 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:09:57 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 1G" returned: 0 in 0.789s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:09:58 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.754s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658091fe-42e2-4614-8eb3-1d068fdbbcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a877276d-ddbd-49d5-b97c-a57ccdd7ec68]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:09:58 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.495s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 is being set with open permissions: ugo+rw Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:58 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:09:58 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:58 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 0.486s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:58 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=126,cinder:INSERT=37,cinder:UPDATE=141,cinder:DELETE=9 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=126,cinder:DELETE=13,cinder:SELECT=112,cinder:INSERT=40 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a7ec8-3906-4eaf-a4a7-6104bc16a98d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:59 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info Sep 28 17:09:59 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:59 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:09:59 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:59 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info" returned: 0 in 0.513s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info is being set with open permissions: ugo+rw Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:59 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 0.616s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658091fe-42e2-4614-8eb3-1d068fdbbcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:59 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info Sep 28 17:09:59 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[74103903-6fdc-438c-840c-0c0ce7d74af9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:00 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:10:00 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:00 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.info" returned: 0 in 0.505s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] snapshot: 6f2f1435-3d65-463d-a226-7d20b848ed85, volume: ad532d62-888b-444c-9ee2-40e96f33bdb8, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac63f9e-7194-4c78-85d4-db852b364220]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:00 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.791s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658091fe-42e2-4614-8eb3-1d068fdbbcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d4561-2550-4ab3-b142-1deae846ea7c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:00 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:10:00 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:00 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:10:00 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.672s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c1dda1-c812-4aa3-bbf3-8a593c544129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae5887-9925-4ecf-aeaf-a2e61a4f7c21]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 0.577s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:10:01 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:10:01 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.506s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.600s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:01 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533 Sep 28 17:10:01 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 Sep 28 17:10:01 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:01 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.3bb8383b-8e38-48b4-8fab-bb5448b7a533" returned: 0 in 0.346s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 -F qcow2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 -F qcow2 Sep 28 17:10:02 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:02 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:02 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:02 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658091fe-42e2-4614-8eb3-1d068fdbbcba /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 -F qcow2" returned: 0 in 0.795s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3bb8383b-8e38-48b4-8fab-bb5448b7a533" released by "_delete_snapshot" :: held 5.323s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" released by "delete_snapshot" :: held 5.381s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:03 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.500s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Created reservations ['0f03c595-cac5-48e9-b9a2-da984d92be97', 'c0b40caa-984a-4be2-9315-04e202458ebd', 'f0c8892e-c1a9-444e-b8f2-35be1d864997', '8341a9e9-fd92-4f43-acf8-a515e1cf2d8d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Delete snapshot completed successfully. Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-3bb8383b-8e38-48b4-8fab-bb5448b7a533-delete_snapshot" released by "delete_snapshot" :: held 6.026s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Deleting offline snapshot d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 of volume 658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] snapshot_file for this snap is: volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbeda12-45cf-413c-8dfa-5b585bf3c34d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:04 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:10:04 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Acquiring lock "cinder-57dd0131-7d9d-4d1f-bad0-d106998ae1ea-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "cinder-57dd0131-7d9d-4d1f-bad0-d106998ae1ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Acquiring lock "cinder-quobyte-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "cinder-quobyte-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" acquired by "delete_volume" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27ff973-da16-4460-9e17-219c6e144bc3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:04 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 1.104s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658091fe-42e2-4614-8eb3-1d068fdbbcba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:05 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea Sep 28 17:10:05 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[62410868-fe71-4b4a-a59c-c90ade8cd0aa]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:05 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:10:05 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" returned: 0 in 1.240s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea Sep 28 17:10:06 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 1.030s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:10:06 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:06 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" returned: 0 in 0.480s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "cinder-quobyte-57dd0131-7d9d-4d1f-bad0-d106998ae1ea" released by "delete_volume" :: held 1.904s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Created reservations ['cadbc0ef-1beb-4cdc-8250-a42f52ab5170', '608a8b08-2217-46dc-aeb2-81c5be06ed8c', '888b4a17-bc22-43cf-9df2-530e25fc872f', '30d4f889-e265-4d51-adad-2e9fc1f125d4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:06 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:06 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:07 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 1.158s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:07 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5 Sep 28 17:10:07 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:07 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.823s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Deleted volume successfully. Sep 28 17:10:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0c4a6ff9-55c0-44b1-aec4-0ed489af7574 tempest-AttachVolumeShelveTestJSON-640873088 None] Lock "cinder-57dd0131-7d9d-4d1f-bad0-d106998ae1ea-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:08 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba.d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" returned: 0 in 0.853s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5" released by "_delete_snapshot" :: held 4.491s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" released by "delete_snapshot" :: held 4.547s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Created reservations ['a00ecd40-66bc-4a17-9509-5db449107be1', 'a4a2f81c-759b-4379-bf35-6e94e3630fb6', 'c9ec8a64-70a8-4ac9-be62-dbe57c52510d', '39fcf5eb-9208-4057-ba70-31aacfac137c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Delete snapshot completed successfully. Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-d4dd0ac3-ce31-4c23-96c0-465d051f7ab5-delete_snapshot" released by "delete_snapshot" :: held 5.083s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Snapshots deleted, issuing volume delete {{(pid=87034) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ce6be-e75d-4c36-8ed8-df20f68acc44]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:09 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:10:09 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:09 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 1.022s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:09 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba Sep 28 17:10:09 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-658091fe-42e2-4614-8eb3-1d068fdbbcba" returned: 0 in 0.750s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-658091fe-42e2-4614-8eb3-1d068fdbbcba" released by "delete_volume" :: held 1.961s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:10 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Created reservations ['bbd52408-d947-4633-b4cf-9fc3885a8c17', 'c626bd0b-14bd-4005-9cde-030d65341a07', '43d815b0-85ce-4d1b-bd49-cfdc0eb4a49e', 'e0a0a8e3-e849-4714-a4fa-bcd208661e10'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:11 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:11 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8" returned: 0 in 10.366s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129, size 1024.00 MB, duration 10.37 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:10:12 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Converted 1024.00 MB image at 98.76 MB/s Sep 28 17:10:12 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 is being set with open permissions: ugo+rw Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 1.055s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:12 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Deleted volume successfully. Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6f51af6-a729-4892-a11b-2b8a88d059db tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-658091fe-42e2-4614-8eb3-1d068fdbbcba-delete_volume" released by "delete_volume" :: held 14.733s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:12 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8" returned: 0 in 0.510s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" released by "_copy_volume_from_snapshot" :: held 12.321s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-6f2f1435-3d65-463d-a226-7d20b848ed85" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-6f2f1435-3d65-463d-a226-7d20b848ed85" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Deleting offline snapshot 6f2f1435-3d65-463d-a226-7d20b848ed85 of volume 72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] snapshot_file for this snap is: volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450b9e2-dd12-488e-8bfb-81dd0219d0d9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:12 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:10:12 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:13 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (0ee98ee5-f474-4ee4-9f6d-4f827b9e26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be945a5-a4bc-48e0-abf4-5562de6c38cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.665s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c1dda1-c812-4aa3-bbf3-8a593c544129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be945a5-a4bc-48e0-abf4-5562de6c38cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-481157107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0c5d934bae4832b2fcd36a5d013dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:13Z,use_quota=True,user_id='1b6a406efb40424ea577b1aeb2b5f9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8175efe-b565-4104-b487-e156d9e19f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8175efe-b565-4104-b487-e156d9e19f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ad96cf-5dc3-437e-a171-1ef87db67afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ad96cf-5dc3-437e-a171-1ef87db67afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5', 'volume_name': 'volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce70ef5-ea0c-4c1d-a2f9-bedbfebac164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce70ef5-ea0c-4c1d-a2f9-bedbfebac164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3641c348-216e-4ec3-abea-ba9a0738226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:13 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Volume 602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5', 'volume_size': 1} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be8b1d-3b76-4166-b35d-22245e27d0b8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:13 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:10:13 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:14 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.672s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:14 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:10:14 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:14 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.506s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:14 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85 Sep 28 17:10:14 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:15 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129.6f2f1435-3d65-463d-a226-7d20b848ed85" returned: 0 in 0.440s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-6f2f1435-3d65-463d-a226-7d20b848ed85" released by "_delete_snapshot" :: held 2.511s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.679s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-481157107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0c5d934bae4832b2fcd36a5d013dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:13Z,use_quota=True,user_id='1b6a406efb40424ea577b1aeb2b5f9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Creating volume 602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:15 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:15 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 1073741824 Sep 28 17:10:15 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5350a5b-1bfb-408f-9a74-cddb563a0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad532d62-888b-444c-9ee2-40e96f33bdb8', 'volume_size': 1, 'source_volid': '72c1dda1-c812-4aa3-bbf3-8a593c544129', 'source_volstatus': 'available'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510bfe5-9c97-41f7-9d55-ae651b57fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:15 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Volume volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 (ad532d62-888b-444c-9ee2-40e96f33bdb8): created successfully Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4510bfe5-9c97-41f7-9d55-ae651b57fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (665faf07-82f1-4660-9b0c-39973ab2ca05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3be4389c-2724-45aa-83e7-f3fc7f98620b tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:10:15 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 1073741824" returned: 0 in 0.654s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:16 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:16 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:16 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.377s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3641c348-216e-4ec3-abea-ba9a0738226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d18134-1263-479f-a12f-ce7dffcf92c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Volume volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 (602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5): created successfully Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d18134-1263-479f-a12f-ce7dffcf92c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (0ee98ee5-f474-4ee4-9f6d-4f827b9e26f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:16 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6e650d4a-fd46-49e0-a2a5-a242f6f8b369 tempest-VolumesDeleteCascade-382344314 None] Created volume successfully. Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (903b14a2-c366-43c4-98e7-0fe3feb4c234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbeb103-85f3-4574-b323-1de9286ed134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbeb103-85f3-4574-b323-1de9286ed134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-276775693',display_name='tempest-VolumesGetTest-Volume-587297252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ecfbd5-8071-489c-bc80-f1e1526c9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:17Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1350bbba-ce9d-4650-a36b-bd80a1ceba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1350bbba-ce9d-4650-a36b-bd80a1ceba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f149135-a0ac-4c06-aa63-19699011e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f149135-a0ac-4c06-aa63-19699011e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ecfbd5-8071-489c-bc80-f1e1526c9a5d', 'volume_name': 'volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a352e7d-d670-40cc-b2b6-ad7902ca3e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a352e7d-d670-40cc-b2b6-ad7902ca3e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaeabbc8-f066-4620-b497-3eb1a891356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Volume a7ecfbd5-8071-489c-bc80-f1e1526c9a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d', 'volume_size': 1} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-276775693',display_name='tempest-VolumesGetTest-Volume-587297252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ecfbd5-8071-489c-bc80-f1e1526c9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:17Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Creating volume a7ecfbd5-8071-489c-bc80-f1e1526c9a5d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:17 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:17 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d 1073741824 Sep 28 17:10:17 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:18 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d 1073741824" returned: 0 in 0.697s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:18 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d Sep 28 17:10:18 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:18 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.664s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaeabbc8-f066-4620-b497-3eb1a891356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6a7908-83ba-40d1-9777-4f73b26ab0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Creating offline snapshot 3e832a4a-9cd1-43ec-9550-b52c051d3aef of volume 602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:18 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Volume volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d (a7ecfbd5-8071-489c-bc80-f1e1526c9a5d): created successfully Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6a7908-83ba-40d1-9777-4f73b26ab0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (903b14a2-c366-43c4-98e7-0fe3feb4c234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9205079-87aa-4430-8218-75b48a5ffc25]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:18 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-82cb7e44-62fd-4673-9a6f-86e5e1dff274 tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:10:18 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:18 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:19 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.405s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:19 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef 1G Sep 28 17:10:19 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "cinder-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:19 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef 1G" returned: 0 in 0.643s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:19 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:19 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcf2880-3c6f-4f02-9089-72bfc4357430]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:20 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d Sep 28 17:10:20 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:20 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.431s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:20 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef is being set with open permissions: ugo+rw Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:20 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:20 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:20 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" returned: 0 in 0.691s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:20 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.331s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:20 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d Sep 28 17:10:20 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:20 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info Sep 28 17:10:20 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:21 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" returned: 0 in 0.455s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d" released by "delete_volume" :: held 1.225s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:21 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info" returned: 0 in 0.494s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info is being set with open permissions: ugo+rw Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:21 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info Sep 28 17:10:21 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Created reservations ['6ceb0796-2d48-4b9a-bd23-43cc7d44e55a', 'ab0eec02-0026-4365-8b06-ff08c31fd6ed', 'd8a096b8-91a6-4f56-a4e5-d5d0b81c74a1', '723c4727-9ed1-422f-abe9-c6c287e48e4e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:21 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:21 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (39b8d780-1195-4a8d-8eca-a58122042fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18e71a-5f76-45f5-bf82-4ac3a6361e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e18e71a-5f76-45f5-bf82-4ac3a6361e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-103949629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44116622-6df3-41fb-95d5-3e749ea19400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:21Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058601ff-aafd-45bc-a055-04148b00204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058601ff-aafd-45bc-a055-04148b00204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f99ee3-2fd4-4c0d-9cf7-34f1aed91b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f99ee3-2fd4-4c0d-9cf7-34f1aed91b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44116622-6df3-41fb-95d5-3e749ea19400', 'volume_name': 'volume-44116622-6df3-41fb-95d5-3e749ea19400', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0ece1f-2e4e-4676-ac91-eb5246a5d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0ece1f-2e4e-4676-ac91-eb5246a5d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095f71a7-4c12-428f-b604-d802a39c4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Volume 44116622-6df3-41fb-95d5-3e749ea19400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44116622-6df3-41fb-95d5-3e749ea19400', 'volume_size': 1} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:21 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.328s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:21 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.info" returned: 0 in 0.563s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.036s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-103949629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44116622-6df3-41fb-95d5-3e749ea19400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:21Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Creating volume 44116622-6df3-41fb-95d5-3e749ea19400 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:10:21 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 1073741824 Sep 28 17:10:21 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-14c51c6c-9cc3-4900-b71b-78c7a4977f10 tempest-VolumesGetTest-927428743 None] Lock "cinder-a7ecfbd5-8071-489c-bc80-f1e1526c9a5d-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-76a41832-b122-4ba6-8e02-aa50e50cdb89 tempest-VolumesDeleteCascade-382344314 None] Create snapshot completed successfully Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-ad532d62-888b-444c-9ee2-40e96f33bdb8-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "cinder-ad532d62-888b-444c-9ee2-40e96f33bdb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" acquired by "delete_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[92892bea-9205-4eb4-8eef-1d0ecb92396b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:22 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 1073741824" returned: 0 in 0.675s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:22 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:22 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:22 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 Sep 28 17:10:22 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:22 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095f71a7-4c12-428f-b604-d802a39c4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44116622-6df3-41fb-95d5-3e749ea19400', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d046a3f-8be9-4096-85b6-e4c5a955e544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Volume volume-44116622-6df3-41fb-95d5-3e749ea19400 (44116622-6df3-41fb-95d5-3e749ea19400): created successfully Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d046a3f-8be9-4096-85b6-e4c5a955e544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (39b8d780-1195-4a8d-8eca-a58122042fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-145d0b67-e17e-4411-b596-b6adfb707586 tempest-VolumesListAdminTestJSON-398353069 None] Created volume successfully. Sep 28 17:10:22 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8" returned: 0 in 0.628s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:22 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8 Sep 28 17:10:22 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (5b8bf020-1f79-4904-a2df-b11eacd8afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5fc724-b376-413f-9410-f4064497fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5fc724-b376-413f-9410-f4064497fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2058206258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd51013-96ac-4682-a011-4e0ca60e8dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0c5d934bae4832b2fcd36a5d013dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e832a4a-9cd1-43ec-9550-b52c051d3aef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:23Z,use_quota=True,user_id='1b6a406efb40424ea577b1aeb2b5f9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b765e1-e319-4570-b5b1-171d25a23d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b765e1-e319-4570-b5b1-171d25a23d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20dec8-e168-463c-b980-615507aef633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20dec8-e168-463c-b980-615507aef633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecd51013-96ac-4682-a011-4e0ca60e8dc9', 'volume_name': 'volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9', 'volume_size': 1, 'snapshot_id': '3e832a4a-9cd1-43ec-9550-b52c051d3aef'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906138d2-ed0d-42e7-ba2d-f1e86db63a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906138d2-ed0d-42e7-ba2d-f1e86db63a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07817b7f-cfe1-4a9b-90a1-497e160ca1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Volume ecd51013-96ac-4682-a011-4e0ca60e8dc9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9', 'volume_size': 1, 'snapshot_id': '3e832a4a-9cd1-43ec-9550-b52c051d3aef'} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef-ecd51013-96ac-4682-a011-4e0ca60e8dc9" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ad532d62-888b-444c-9ee2-40e96f33bdb8" returned: 0 in 0.435s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:23 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef-ecd51013-96ac-4682-a011-4e0ca60e8dc9" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Creating volume ecd51013-96ac-4682-a011-4e0ca60e8dc9 from snapshot 3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-ad532d62-888b-444c-9ee2-40e96f33bdb8" released by "delete_volume" :: held 1.173s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] snapshot: 3e832a4a-9cd1-43ec-9550-b52c051d3aef, volume: ecd51013-96ac-4682-a011-4e0ca60e8dc9, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Created reservations ['58a7b3ea-3c6f-47c4-a3e8-e0765b7ad8f3', 'ca515bf7-f7df-4f36-9c30-a451c153fffa', 'de236b66-62d4-43ba-b7db-77427bf77932', '2945859c-e9e2-4c30-b9ef-9ae425838ec4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a9368-e151-44a7-9799-496b17065973]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:23 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:23 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:23 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:23 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:24 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-75b41196-c71d-4d60-b015-0d30dc246002 tempest-VolumesGetTest-927428743 None] Lock "cinder-ad532d62-888b-444c-9ee2-40e96f33bdb8-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:24 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.660s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e589e83-6a36-4713-a0fb-ff612dc074e1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:24 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (9035c192-e23b-42cd-af3b-5b55d2041d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8639abe4-7b24-4b36-9e6c-67d9e06eeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8639abe4-7b24-4b36-9e6c-67d9e06eeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106630068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9878afd8-ec60-4657-9a78-57940d62d187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:24Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9287873-2055-40db-b311-cd1e23d4faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9287873-2055-40db-b311-cd1e23d4faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a12c5f-108b-4568-970e-8c6b7f400981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a12c5f-108b-4568-970e-8c6b7f400981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9878afd8-ec60-4657-9a78-57940d62d187', 'volume_name': 'volume-9878afd8-ec60-4657-9a78-57940d62d187', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f31de-9146-497c-95cc-1dcd7005029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f31de-9146-497c-95cc-1dcd7005029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ba5c52-bcf5-4d68-ad39-f9d5bd67ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Volume 9878afd8-ec60-4657-9a78-57940d62d187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9878afd8-ec60-4657-9a78-57940d62d187', 'volume_size': 1} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-72c1dda1-c812-4aa3-bbf3-8a593c544129-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "cinder-72c1dda1-c812-4aa3-bbf3-8a593c544129-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-72c1dda1-c812-4aa3-bbf3-8a593c544129" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-72c1dda1-c812-4aa3-bbf3-8a593c544129" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473697f-797a-4ebf-b1fe-257d1c9f445c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.671s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:10:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 Sep 28 17:10:24 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:25 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:10:25 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:25 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.498s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:25 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129 Sep 28 17:10:25 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:25 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-72c1dda1-c812-4aa3-bbf3-8a593c544129" returned: 0 in 0.417s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-72c1dda1-c812-4aa3-bbf3-8a593c544129" released by "delete_volume" :: held 1.047s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:25 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Created reservations ['6ecccb3f-8166-4f8f-b088-0fe84c6e6d81', '946e7a3d-b3eb-4b4c-bf04-6d95ed750613', 'c0aa7e99-74ad-42c2-9026-4685c8dd03b1', '864fe132-d7c5-41d2-84da-99edb2b77f0d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:26 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.559s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:10:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-836c2050-7a15-4cb4-8b81-0e99fbe6a117 tempest-VolumesGetTest-927428743 None] Lock "cinder-72c1dda1-c812-4aa3-bbf3-8a593c544129-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (92803d85-5a95-4639-a307-90ce64fe6116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace88c83-82ff-431e-9511-34852dccc056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace88c83-82ff-431e-9511-34852dccc056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-453941732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ab0ed2-f44b-4e23-85fb-999ae756dadc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:29Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf536dcb-c511-4a62-9795-37957f777a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf536dcb-c511-4a62-9795-37957f777a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d2f08f-da03-4139-a480-bf0e4c0a0640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:10:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d2f08f-da03-4139-a480-bf0e4c0a0640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18ab0ed2-f44b-4e23-85fb-999ae756dadc', 'volume_name': 'volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d4cf61-80f9-4a82-b35d-c06f5801beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d4cf61-80f9-4a82-b35d-c06f5801beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf657340-dd97-4673-9ffd-e225f2d5e19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:30 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:10:30 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Trying to clone 18ab0ed2-f44b-4e23-85fb-999ae756dadc from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:10:31 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:10:31 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:10:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ce6c5a-c849-40b8-9c4c-c69ac4aa0b42]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:31 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD Sep 28 17:10:32 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:32 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD" returned: 0 in 1.190s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:32 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef is fetched for user e5b88c3fbd8f4668b14979c198219fe9. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:10:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[95831bde-2c79-4d56-b817-d44b5d912492]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:33 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD Sep 28 17:10:33 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:33 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:34 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9" returned: 0 in 9.508s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5, size 1024.00 MB, duration 9.51 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:10:34 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Converted 1024.00 MB image at 107.69 MB/s Sep 28 17:10:34 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 is being set with open permissions: ugo+rw Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:34 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 Sep 28 17:10:34 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:34 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" released by "_copy_volume_from_snapshot" :: held 11.312s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef-ecd51013-96ac-4682-a011-4e0ca60e8dc9" released by "_create_volume_from_snapshot" :: held 11.435s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.468s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.209s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1106630068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9878afd8-ec60-4657-9a78-57940d62d187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:24Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Creating volume 9878afd8-ec60-4657-9a78-57940d62d187 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:34 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 1073741824 Sep 28 17:10:34 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07817b7f-cfe1-4a9b-90a1-497e160ca1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9', 'volume_size': 1, 'snapshot_id': '3e832a4a-9cd1-43ec-9550-b52c051d3aef'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3180c4-9821-4b07-8268-d659c845072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Volume volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 (ecd51013-96ac-4682-a011-4e0ca60e8dc9): created successfully Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3180c4-9821-4b07-8268-d659c845072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Flow 'volume_create_manager' (5b8bf020-1f79-4904-a2df-b11eacd8afd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1bc6f1c1-5b1b-4bef-b128-92504292c6ab tempest-VolumesDeleteCascade-382344314 None] Created volume successfully. Sep 28 17:10:35 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 1073741824" returned: 0 in 0.594s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:35 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 Sep 28 17:10:35 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:35 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187" returned: 0 in 0.328s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-453941732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ab0ed2-f44b-4e23-85fb-999ae756dadc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:29Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Creating volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:35 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:35 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1073741824 Sep 28 17:10:35 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ba5c52-bcf5-4d68-ad39-f9d5bd67ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9878afd8-ec60-4657-9a78-57940d62d187', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c31505f-ebf4-4628-b774-f7ef09af4e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Volume volume-9878afd8-ec60-4657-9a78-57940d62d187 (9878afd8-ec60-4657-9a78-57940d62d187): created successfully Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c31505f-ebf4-4628-b774-f7ef09af4e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (9035c192-e23b-42cd-af3b-5b55d2041d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Performing cascade delete. {{(pid=87034) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-3e832a4a-9cd1-43ec-9550-b52c051d3aef-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-aa9d09a2-d94c-46e7-934b-87f57a56dc57 tempest-VolumesListAdminTestJSON-398353069 None] Created volume successfully. Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-3e832a4a-9cd1-43ec-9550-b52c051d3aef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Deleting offline snapshot 3e832a4a-9cd1-43ec-9550-b52c051d3aef of volume 602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] snapshot_file for this snap is: volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b95e22-de45-4a9f-aff1-bee6d67441b8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:36 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:36 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:36 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1073741824" returned: 0 in 0.717s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:36 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc Sep 28 17:10:36 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:36 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.560s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa791fcc-0cdc-4140-b5ed-44d1c65bc66c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:36 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:36 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:36 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc" returned: 0 in 0.351s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Attempting download of 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8cf381-1e6f-4013-8254-e6eec1a507fc]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r Sep 28 17:10:37 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:37 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.949s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r" returned: 0 in 0.646s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:37 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (027846cb-9d10-41a2-9ce0-bee65c207bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cbb7ff-6c61-4ac2-a2ba-a01a21cfd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:38 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r Sep 28 17:10:38 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cbb7ff-6c61-4ac2-a2ba-a01a21cfd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473551320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdca9c2-e514-49f1-8910-6d19324e330f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:38Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4704cec-8742-4f49-a370-01f0e1bb760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4704cec-8742-4f49-a370-01f0e1bb760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6043b996-e9d8-4be1-91aa-912d9da21600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6043b996-e9d8-4be1-91aa-912d9da21600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdca9c2-e514-49f1-8910-6d19324e330f', 'volume_name': 'volume-1cdca9c2-e514-49f1-8910-6d19324e330f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e6f4e2-3aee-4cd4-a5ca-102c8b1229dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e6f4e2-3aee-4cd4-a5ca-102c8b1229dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a7d60d-c1e9-442f-b847-57c46b453aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Volume 1cdca9c2-e514-49f1-8910-6d19324e330f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdca9c2-e514-49f1-8910-6d19324e330f', 'volume_size': 1} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473551320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdca9c2-e514-49f1-8910-6d19324e330f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf33a6c13e8473ea3f6d3fffdff32b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:38Z,use_quota=True,user_id='8142f30fe97a478dae0a55489383cacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Creating volume 1cdca9c2-e514-49f1-8910-6d19324e330f {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:38 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f 1073741824 Sep 28 17:10:38 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:38 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.741s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:38 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r" returned: 1 in 0.757s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_14nr2l8r' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[087acacd-a859-499f-bac6-ecd953c6e969]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:38 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef Sep 28 17:10:38 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:38 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD Sep 28 17:10:38 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:38 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5.3e832a4a-9cd1-43ec-9550-b52c051d3aef" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-3e832a4a-9cd1-43ec-9550-b52c051d3aef" released by "_delete_snapshot" :: held 2.857s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" released by "delete_snapshot" :: held 2.893s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:39 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f 1073741824" returned: 0 in 0.979s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Created reservations ['c5759d6f-06c7-4d6c-b265-534449cd135f', 'eb148c35-ccc2-441c-b605-91c637864974', 'c9e8686e-e31a-4562-a4a5-1adec8e28d9f', '2f2f979c-70d7-4187-aeb4-02e5742b0de2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:39 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:39 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc Sep 28 17:10:39 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:39 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f Sep 28 17:10:39 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Delete snapshot completed successfully. Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-3e832a4a-9cd1-43ec-9550-b52c051d3aef-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Snapshots deleted, issuing volume delete {{(pid=87034) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b536e-f51c-405b-828c-4b51e83639ef]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:39 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:39 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:39 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f" returned: 0 in 0.429s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a7d60d-c1e9-442f-b847-57c46b453aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdca9c2-e514-49f1-8910-6d19324e330f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6548e7-c9d8-49d5-b7e0-0b8411098b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Volume volume-1cdca9c2-e514-49f1-8910-6d19324e330f (1cdca9c2-e514-49f1-8910-6d19324e330f): created successfully Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6548e7-c9d8-49d5-b7e0-0b8411098b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Flow 'volume_create_manager' (027846cb-9d10-41a2-9ce0-bee65c207bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2e2d256b-9371-4463-87f3-c778d76f03ff tempest-VolumesListAdminTestJSON-398353069 None] Created volume successfully. Sep 28 17:10:39 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.591s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:39 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5 Sep 28 17:10:39 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:40 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" returned: 0 in 0.407s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5" released by "delete_volume" :: held 1.126s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Created reservations ['683f627e-49e5-47ca-8237-687b0d54ea32', '7a515da8-e4ef-4007-ac43-e9761d055a5d', 'cb827e40-b74c-40c4-a3a0-3cbbd532138f', '93e74583-d8cf-4c8d-9927-37c169a06e20'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:40 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:40 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:41 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.415s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Deleted volume successfully. Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f8501f32-2c25-4152-adc3-577a5f5ff980 tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-602dfd7a-d2ad-4aaa-8607-0fe719b7f7b5-delete_volume" released by "delete_volume" :: held 5.267s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Flow 'volume_create_manager' (1a49ad03-be08-4112-b9ab-ce8bc100ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f5999f-1575-470d-8c34-cb683b0a0e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f5999f-1575-470d-8c34-cb683b0a0e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c24c973-4ed8-4f12-821e-470dbdb6f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cacf852cc644619e26dc23a2b40fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:42Z,use_quota=True,user_id='1dff9b4ac9114f41bafac080211f4159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5cce78-522d-4bd3-b8db-45b27c26c7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5cce78-522d-4bd3-b8db-45b27c26c7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8873206d-c0a3-43c8-888d-e419440af082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8873206d-c0a3-43c8-888d-e419440af082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c24c973-4ed8-4f12-821e-470dbdb6f0db', 'volume_name': 'volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd281adf-2b08-4811-8291-867b31139b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd281adf-2b08-4811-8291-867b31139b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356286e8-24ab-4cdf-81cd-0ea712c50799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Volume 2c24c973-4ed8-4f12-821e-470dbdb6f0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db', 'volume_size': 1} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c24c973-4ed8-4f12-821e-470dbdb6f0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cacf852cc644619e26dc23a2b40fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:42Z,use_quota=True,user_id='1dff9b4ac9114f41bafac080211f4159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Creating volume 2c24c973-4ed8-4f12-821e-470dbdb6f0db {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:41 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:41 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db 1073741824 Sep 28 17:10:41 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-ecd51013-96ac-4682-a011-4e0ca60e8dc9-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-ecd51013-96ac-4682-a011-4e0ca60e8dc9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0665d1-1331-4fd5-b456-e581db8c4978]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:42 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 Sep 28 17:10:42 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:42 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc" returned: 0 in 3.243s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_257dpaekdevstack@QuobyteHD, size 112.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:10:42 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Converted 112.00 MB image at 34.51 MB/s Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:42 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1G Sep 28 17:10:42 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:42 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db 1073741824" returned: 0 in 0.836s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:42 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db Sep 28 17:10:42 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:42 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9" returned: 0 in 0.658s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:42 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9 Sep 28 17:10:42 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:42 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc 1G" returned: 0 in 0.590s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Downloaded image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef for user e5b88c3fbd8f4668b14979c198219fe9 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:10:42 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Marking volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Copying metadata from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef to 18ab0ed2-f44b-4e23-85fb-999ae756dadc. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Creating volume glance metadata for volume 18ab0ed2-f44b-4e23-85fb-999ae756dadc backed by image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:10:43 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf657340-dd97-4673-9ffd-e225f2d5e19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f548050-ee60-4139-8ba8-33ba26b2bc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356286e8-24ab-4cdf-81cd-0ea712c50799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1add1c5-7dd7-4d61-81cb-144ea9ae9f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Volume volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc (18ab0ed2-f44b-4e23-85fb-999ae756dadc): created successfully Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f548050-ee60-4139-8ba8-33ba26b2bc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (92803d85-5a95-4639-a307-90ce64fe6116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Volume volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db (2c24c973-4ed8-4f12-821e-470dbdb6f0db): created successfully Sep 28 17:10:43 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1add1c5-7dd7-4d61-81cb-144ea9ae9f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Flow 'volume_create_manager' (1a49ad03-be08-4112-b9ab-ce8bc100ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ecd51013-96ac-4682-a011-4e0ca60e8dc9" returned: 0 in 0.541s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3be25aa8-6349-4ac8-bd45-47cc6e2f7d48 tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-quobyte-ecd51013-96ac-4682-a011-4e0ca60e8dc9" released by "delete_volume" :: held 1.287s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4d7839cb-c2e3-4584-820e-7b0f2e98ff86 tempest-VolumesListAdminTestJSON-579624357 None] Created volume successfully. Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Created reservations ['a4965b57-9b47-4e9e-9bba-303d20b035ab', '9b0331f1-00ba-44af-9dc8-4a7016c2b147', '2b43f5b2-0f53-4f71-b441-55ece2add864', 'b706cdf2-f8f3-4290-99c3-c556629fe11b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:43 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:43 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:43 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Acquiring lock "cinder-2c24c973-4ed8-4f12-821e-470dbdb6f0db-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Deleted volume successfully. Sep 28 17:10:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "cinder-2c24c973-4ed8-4f12-821e-470dbdb6f0db-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d68c93d7-0511-4554-854e-d948c8f2041d tempest-VolumesDeleteCascade-382344314 None] Lock "cinder-ecd51013-96ac-4682-a011-4e0ca60e8dc9-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Acquiring lock "cinder-quobyte-2c24c973-4ed8-4f12-821e-470dbdb6f0db" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "cinder-quobyte-2c24c973-4ed8-4f12-821e-470dbdb6f0db" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bd721-ae9d-4390-b638-659df3c0b296]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-1cdca9c2-e514-49f1-8910-6d19324e330f-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-1cdca9c2-e514-49f1-8910-6d19324e330f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-quobyte-1cdca9c2-e514-49f1-8910-6d19324e330f" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-1cdca9c2-e514-49f1-8910-6d19324e330f" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a24ffdb-2c41-4c28-ace4-1b3d308e3eec]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db Sep 28 17:10:44 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:44 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f Sep 28 17:10:44 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:44 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db" returned: 0 in 0.762s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db Sep 28 17:10:44 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f" returned: 0 in 0.761s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:45 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f Sep 28 17:10:45 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2c24c973-4ed8-4f12-821e-470dbdb6f0db" returned: 0 in 0.649s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "cinder-quobyte-2c24c973-4ed8-4f12-821e-470dbdb6f0db" released by "delete_volume" :: held 1.525s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Created reservations ['29f3bbc6-de9f-49b5-9720-200c61f0daf0', '8412df89-9689-4592-80b7-4b42ff19e840', 'da485d23-8760-4e0a-bbfd-38e400ac73ac', '5462a2df-e1ec-4438-ba17-6873123848d6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:45 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1cdca9c2-e514-49f1-8910-6d19324e330f" returned: 0 in 0.613s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-1cdca9c2-e514-49f1-8910-6d19324e330f" released by "delete_volume" :: held 1.495s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (a8ecdb8a-4046-4774-86e3-7245a2de6d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa01df-ef06-4178-9538-d5c49e238a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa01df-ef06-4178-9538-d5c49e238a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1555848295',display_name='tempest-VolumesGetTest-Volume-592216244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:46Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ede69-732d-4dab-9abf-d0c7be900cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ede69-732d-4dab-9abf-d0c7be900cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cc275b-5a6f-4881-80da-0fe48a013463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cc275b-5a6f-4881-80da-0fe48a013463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb', 'volume_name': 'volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f62d79-e8b2-4b2d-8ed5-95a9d00403b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f62d79-e8b2-4b2d-8ed5-95a9d00403b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95850301-86c0-47aa-9bc7-40630a3f9e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Volume 4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb', 'volume_size': 1} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1555848295',display_name='tempest-VolumesGetTest-Volume-592216244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0465e05092924a7d8f126ca5d9e4dd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:46Z,use_quota=True,user_id='e5b88c3fbd8f4668b14979c198219fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Creating volume 4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:46 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:46 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb 1073741824 Sep 28 17:10:46 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:46 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:46 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Created reservations ['3f0d1df1-70f5-4197-a9d6-89b03b7bc317', 'bb8cf079-2a56-4896-b7fa-74fc66dbdb5a', 'be41bb6f-4580-4562-8eec-60f325644950', '85b0f4a3-d675-4891-b28b-1052a2c1189d'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:46 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:46 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.593s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:46 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Deleted volume successfully. Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c33a28c2-dccb-403f-b79e-f0bebc78d4a4 tempest-VolumesListAdminTestJSON-579624357 None] Lock "cinder-2c24c973-4ed8-4f12-821e-470dbdb6f0db-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:46 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb 1073741824" returned: 0 in 0.963s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:47 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.562s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Deleted volume successfully. Sep 28 17:10:47 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb Sep 28 17:10:47 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-9878afd8-ec60-4657-9a78-57940d62d187-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-9878afd8-ec60-4657-9a78-57940d62d187-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c4af2b37-429c-4947-9188-e14e2c8b494a tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-1cdca9c2-e514-49f1-8910-6d19324e330f-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-quobyte-9878afd8-ec60-4657-9a78-57940d62d187" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-9878afd8-ec60-4657-9a78-57940d62d187" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[73746516-faa9-4804-98a3-81b13b72c292]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:47 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:47 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 Sep 28 17:10:47 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95850301-86c0-47aa-9bc7-40630a3f9e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d4b46-f025-49ca-ac0f-983ac00d5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Volume volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb (4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb): created successfully Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d4b46-f025-49ca-ac0f-983ac00d5933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Flow 'volume_create_manager' (a8ecdb8a-4046-4774-86e3-7245a2de6d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8f641996-4421-4d9f-a021-2bb2f6fa05e7 tempest-VolumesGetTest-927428743 None] Created volume successfully. Sep 28 17:10:47 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187" returned: 0 in 0.633s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187 Sep 28 17:10:48 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "cinder-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:48 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9878afd8-ec60-4657-9a78-57940d62d187" returned: 0 in 0.642s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-9878afd8-ec60-4657-9a78-57940d62d187" released by "delete_volume" :: held 1.374s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c8c10-890b-4049-8022-e05ac0e95785]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Created reservations ['e62c8a4d-01d8-4850-b828-5c64b39ec592', 'bacb3f9c-d80e-44df-867f-85fde7a994dc', '2c4395bc-d3af-4852-a1cc-a2c4f069f719', '6b18b558-16e5-4fe1-bff6-959044235d5a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:48 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb Sep 28 17:10:48 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:49 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" returned: 0 in 0.583s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.428s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:49 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb Sep 28 17:10:49 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Deleted volume successfully. Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-590737ac-6274-4e9c-8efc-3ce108f3335b tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-9878afd8-ec60-4657-9a78-57940d62d187-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-44116622-6df3-41fb-95d5-3e749ea19400-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-44116622-6df3-41fb-95d5-3e749ea19400-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:49 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" returned: 0 in 0.503s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb" released by "delete_volume" :: held 1.187s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "cinder-quobyte-44116622-6df3-41fb-95d5-3e749ea19400" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-44116622-6df3-41fb-95d5-3e749ea19400" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[417df279-618c-416e-980b-f13b240f3bb8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Created reservations ['cd5c6f48-dbaa-4b5b-b2ff-a507c2f5fec5', 'ad96b90f-fa2d-4182-8a6c-0acb5cf77c4e', '91ccc767-57ae-42b0-b1ce-1fa22ab60925', '0e49a084-227d-489d-9b29-f77ee71e7b79'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:50 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 Sep 28 17:10:50 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.370s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-357892ce-eb32-495e-bbcf-174f140ab5c0 tempest-VolumesGetTest-927428743 None] Lock "cinder-4bbebe89-d4b6-4a6e-8bb9-2c8b761ad4fb-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:50 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400" returned: 0 in 0.762s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400 Sep 28 17:10:50 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-18ab0ed2-f44b-4e23-85fb-999ae756dadc-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "cinder-18ab0ed2-f44b-4e23-85fb-999ae756dadc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Acquiring lock "cinder-quobyte-18ab0ed2-f44b-4e23-85fb-999ae756dadc" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-18ab0ed2-f44b-4e23-85fb-999ae756dadc" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a009e5e-2696-4f82-8676-e7647ee7bbbc]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:51 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-44116622-6df3-41fb-95d5-3e749ea19400" returned: 0 in 0.436s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-quobyte-44116622-6df3-41fb-95d5-3e749ea19400" released by "delete_volume" :: held 1.266s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Created reservations ['397228e0-2f26-427e-802c-c2ce5c33b2e0', '3b01fe0a-983a-42d5-9bf1-d7fdbf4c6dd4', '27052079-7431-4b6c-96d0-d86a1f3a5f94', '1f07d510-3e83-47ee-bdb9-f8035a2e6a31'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:51 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc Sep 28 17:10:51 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:51 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:51 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.410s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc" returned: 0 in 0.679s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Deleted volume successfully. Sep 28 17:10:51 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc Sep 28 17:10:51 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2c028a43-9d8c-42ef-9534-8fdf00cfc2d2 tempest-VolumesListAdminTestJSON-398353069 None] Lock "cinder-44116622-6df3-41fb-95d5-3e749ea19400-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:52 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-18ab0ed2-f44b-4e23-85fb-999ae756dadc" returned: 0 in 0.672s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "cinder-quobyte-18ab0ed2-f44b-4e23-85fb-999ae756dadc" released by "delete_volume" :: held 1.459s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Flow 'volume_create_manager' (f2675981-6bbd-4eb5-bc28-fc62f25471ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c84b322-3138-4ebe-bf57-d168876dcad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c84b322-3138-4ebe-bf57-d168876dcad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-454104450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7277fa-ef64-48f0-b7d5-2aa402efcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b9ae00c75242aca635d5e7024f4cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:53Z,use_quota=True,user_id='3e01ff5092bc4dd3ab1362b70d208c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8ffa1d-16d9-4e21-826c-ccaea1a2ef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8ffa1d-16d9-4e21-826c-ccaea1a2ef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db1fdd1-48af-4418-b08c-7f7bdb57c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db1fdd1-48af-4418-b08c-7f7bdb57c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7277fa-ef64-48f0-b7d5-2aa402efcf90', 'volume_name': 'volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af8450b-d4ec-4497-b5a9-2480f8733170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af8450b-d4ec-4497-b5a9-2480f8733170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8080afc-6bf1-4839-b87b-bc351db7f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Volume fa7277fa-ef64-48f0-b7d5-2aa402efcf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90', 'volume_size': 1} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-454104450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7277fa-ef64-48f0-b7d5-2aa402efcf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b9ae00c75242aca635d5e7024f4cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:53Z,use_quota=True,user_id='3e01ff5092bc4dd3ab1362b70d208c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Creating volume fa7277fa-ef64-48f0-b7d5-2aa402efcf90 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:52 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:10:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:53 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 1073741824 Sep 28 17:10:53 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Created reservations ['9e66f12e-1a26-461f-940d-a8a154d47d1b', '91eb9429-5eeb-4f4b-91d7-e08f66428311', '969ee193-b826-45c1-8110-6b5e7e591bd4', '94260919-22d4-4204-863f-a9a666674500'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:53 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:10:53 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:54 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.713s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:54 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Deleted volume successfully. Sep 28 17:10:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b4327571-dfa0-4e8d-9bad-67b031383df0 tempest-VolumesGetTest-927428743 None] Lock "cinder-18ab0ed2-f44b-4e23-85fb-999ae756dadc-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:54 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 1073741824" returned: 0 in 1.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:54 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 Sep 28 17:10:54 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:55 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" returned: 0 in 0.516s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8080afc-6bf1-4839-b87b-bc351db7f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d76730-68ef-44f3-9fe0-34e84bb45518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Volume volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 (fa7277fa-ef64-48f0-b7d5-2aa402efcf90): created successfully Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d76730-68ef-44f3-9fe0-34e84bb45518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Flow 'volume_create_manager' (f2675981-6bbd-4eb5-bc28-fc62f25471ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4a6bd624-ec3f-42e7-ac44-87e0608691d3 tempest-VolumesMetadataTest-973951720 None] Created volume successfully. Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Acquiring lock "cinder-fa7277fa-ef64-48f0-b7d5-2aa402efcf90-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "cinder-fa7277fa-ef64-48f0-b7d5-2aa402efcf90-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Acquiring lock "cinder-quobyte-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "cinder-quobyte-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[71779ff8-568c-4acf-bafe-12505e12856a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:58 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 Sep 28 17:10:58 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:59 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" returned: 0 in 0.765s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:59 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90 Sep 28 17:10:59 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:59 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" returned: 0 in 0.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "cinder-quobyte-fa7277fa-ef64-48f0-b7d5-2aa402efcf90" released by "delete_volume" :: held 1.294s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=118,cinder:INSERT=53,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=113,cinder:INSERT=37,cinder:UPDATE=161,cinder:DELETE=12 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Created reservations ['99a57b42-13fd-4e20-9104-3e211fcc2cfc', '8118d6d7-4fa7-4d28-8944-559894738fc6', '6a7362b9-2499-4e66-975c-1887ed05665a', '0e436135-413d-481a-9a5e-8160af09e8f3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:00 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:11:00 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.657s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Deleted volume successfully. Sep 28 17:11:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5160f5c8-b0e6-440a-9c93-8e5aa475fbb3 tempest-VolumesMetadataTest-973951720 None] Lock "cinder-fa7277fa-ef64-48f0-b7d5-2aa402efcf90-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:02 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:11:02 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:03 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.505s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:11:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Flow 'volume_create_manager' (378625b3-d29a-4109-905a-4557845a8ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53eb0a1-d383-4003-80e9-3f9f1bc60933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e53eb0a1-d383-4003-80e9-3f9f1bc60933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1289208741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774d519b-0e33-4914-afc3-7087e978ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75642be3d753460499c7249f08602045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:05Z,use_quota=True,user_id='433611a12adf4b1c8c297b57ea724c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8661cc-4698-4629-a2b7-7658071f4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8661cc-4698-4629-a2b7-7658071f4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76450f3c-84f6-4dfc-94be-b0411d19059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:05 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76450f3c-84f6-4dfc-94be-b0411d19059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '774d519b-0e33-4914-afc3-7087e978ce99', 'volume_name': 'volume-774d519b-0e33-4914-afc3-7087e978ce99', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9170b5-25b1-4630-858d-067e0d43b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9170b5-25b1-4630-858d-067e0d43b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cc06b3-0859-4313-a037-9830a41bb57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:06 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Volume 774d519b-0e33-4914-afc3-7087e978ce99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-774d519b-0e33-4914-afc3-7087e978ce99', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Trying to clone 774d519b-0e33-4914-afc3-7087e978ce99 from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:11:06 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65efb0f-a738-4204-bb38-2d22dfb01631]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD Sep 28 17:11:07 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef is fetched for user 433611a12adf4b1c8c297b57ea724c32. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55c1764-b8ed-4601-af6b-dfb7ceb6faba]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD Sep 28 17:11:07 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1289208741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774d519b-0e33-4914-afc3-7087e978ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75642be3d753460499c7249f08602045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:05Z,use_quota=True,user_id='433611a12adf4b1c8c297b57ea724c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Creating volume 774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:08 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1073741824 Sep 28 17:11:08 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1073741824" returned: 0 in 0.682s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 Sep 28 17:11:08 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99" returned: 0 in 0.365s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Attempting download of 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 774d519b-0e33-4914-afc3-7087e978ce99. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b67afe-da38-4777-9cb1-f0d02dd470af]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv Sep 28 17:11:09 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv" returned: 0 in 0.554s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:10 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv Sep 28 17:11:10 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv" returned: 1 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_smy1u8dv' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd932d30-08a2-4feb-b041-4a9feaaed4d9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:10 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD Sep 28 17:11:10 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:11:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:11 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 Sep 28 17:11:11 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:14 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99" returned: 0 in 3.111s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_mg3h7uv8devstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:14 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Converted 112.00 MB image at 35.98 MB/s Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:14 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1G Sep 28 17:11:14 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:14 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 1G" returned: 0 in 0.478s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Downloaded image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 774d519b-0e33-4914-afc3-7087e978ce99 successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef for user 433611a12adf4b1c8c297b57ea724c32 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Marking volume 774d519b-0e33-4914-afc3-7087e978ce99 as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Copying metadata from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef to 774d519b-0e33-4914-afc3-7087e978ce99. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Creating volume glance metadata for volume 774d519b-0e33-4914-afc3-7087e978ce99 backed by image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cc06b3-0859-4313-a037-9830a41bb57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774d519b-0e33-4914-afc3-7087e978ce99', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab63be93-e013-46a0-a48f-5eef52867249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:14 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Volume volume-774d519b-0e33-4914-afc3-7087e978ce99 (774d519b-0e33-4914-afc3-7087e978ce99): created successfully Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab63be93-e013-46a0-a48f-5eef52867249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Flow 'volume_create_manager' (378625b3-d29a-4109-905a-4557845a8ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c854de78-89ef-4d05-b27c-0f447a0a9f5c tempest-VolumesImageMetadata-1325302635 None] Created volume successfully. Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Acquiring lock "cinder-774d519b-0e33-4914-afc3-7087e978ce99-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "cinder-774d519b-0e33-4914-afc3-7087e978ce99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Acquiring lock "cinder-quobyte-774d519b-0e33-4914-afc3-7087e978ce99" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "cinder-quobyte-774d519b-0e33-4914-afc3-7087e978ce99" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31c86d-5422-48aa-9550-b685074e3332]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:16 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 Sep 28 17:11:16 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (f70574e9-f68c-4eaa-ae41-78034bd87c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34b1286-2cd1-4cda-a53b-9fa5bdee1d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34b1286-2cd1-4cda-a53b-9fa5bdee1d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-636861796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d45594-d0ae-4a12-aa10-60c578dadefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:17Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63dad12-72c8-4b94-9c2c-4c4d204f94c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63dad12-72c8-4b94-9c2c-4c4d204f94c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63a817b-5d78-4275-825f-5ab18beeddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63a817b-5d78-4275-825f-5ab18beeddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d45594-d0ae-4a12-aa10-60c578dadefb', 'volume_name': 'volume-a1d45594-d0ae-4a12-aa10-60c578dadefb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e4e7e8-9556-467b-af35-b8612b435a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e4e7e8-9556-467b-af35-b8612b435a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc492cd2-6afe-45a5-b40d-d664035660d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume a1d45594-d0ae-4a12-aa10-60c578dadefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d45594-d0ae-4a12-aa10-60c578dadefb', 'volume_size': 1} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-636861796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d45594-d0ae-4a12-aa10-60c578dadefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:17Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating volume a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:16 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:16 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb 1073741824 Sep 28 17:11:16 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99" returned: 0 in 0.552s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:17 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99 Sep 28 17:11:17 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-774d519b-0e33-4914-afc3-7087e978ce99" returned: 0 in 0.332s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "cinder-quobyte-774d519b-0e33-4914-afc3-7087e978ce99" released by "delete_volume" :: held 1.000s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Created reservations ['5c576ebe-661b-410f-8e95-3a99b6b7ee54', 'f01302d7-ba9a-422e-b53b-57ccc4653e15', '09a416be-1492-46c6-b2ba-f75dc38329ce', 'be2d4e3d-e4b5-4d26-87a0-0ad86f1f04ab'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:17 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb 1073741824" returned: 0 in 0.617s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:17 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:11:17 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:17 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb Sep 28 17:11:17 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:17 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:17 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.332s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Deleted volume successfully. Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc492cd2-6afe-45a5-b40d-d664035660d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d45594-d0ae-4a12-aa10-60c578dadefb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feeba584-ec7a-4252-b463-c0682fadebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume volume-a1d45594-d0ae-4a12-aa10-60c578dadefb (a1d45594-d0ae-4a12-aa10-60c578dadefb): created successfully Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feeba584-ec7a-4252-b463-c0682fadebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (f70574e9-f68c-4eaa-ae41-78034bd87c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a2e63096-685f-4227-9ded-66c7fc5f98f5 tempest-VolumesImageMetadata-1325302635 None] Lock "cinder-774d519b-0e33-4914-afc3-7087e978ce99-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-083fabd3-1b6c-42fa-852a-131f720ef0a8 tempest-VolumesSnapshotTestJSON-1164827402 None] Created volume successfully. Sep 28 17:11:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating offline snapshot f81eebd8-8e60-479b-a102-32627f2f78bf of volume a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:11:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ef68a-48f0-42dd-ae76-d2b59b8bc34b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:20 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb Sep 28 17:11:20 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:20 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb" returned: 0 in 0.590s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:20 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf 1G Sep 28 17:11:20 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:21 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf 1G" returned: 0 in 0.673s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d45594-d0ae-4a12-aa10-60c578dadefb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:21 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d45594-d0ae-4a12-aa10-60c578dadefb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf Sep 28 17:11:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:21 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d45594-d0ae-4a12-aa10-60c578dadefb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf" returned: 0 in 0.604s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf is being set with open permissions: ugo+rw Sep 28 17:11:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:21 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf Sep 28 17:11:21 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:22 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:22 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info Sep 28 17:11:22 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:22 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info" returned: 0 in 0.685s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:22 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info is being set with open permissions: ugo+rw Sep 28 17:11:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:22 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info Sep 28 17:11:22 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (76637ec8-1fc8-4f27-ae84-ff4c28cce2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db61f48-42fe-4a6e-b0e6-b92b7f43d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db61f48-42fe-4a6e-b0e6-b92b7f43d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1828374523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c82f103-dae4-42be-9cdc-13ee6a29f48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:23Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73186724-88ba-44f6-a6fe-d4043b737e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73186724-88ba-44f6-a6fe-d4043b737e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6c639-d1fc-4c70-ab24-96b97f7d2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6c639-d1fc-4c70-ab24-96b97f7d2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c82f103-dae4-42be-9cdc-13ee6a29f48d', 'volume_name': 'volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:23 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995f7198-fa28-48cd-88e5-58da2d4b708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995f7198-fa28-48cd-88e5-58da2d4b708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aaf147-a1a9-4ca0-a3e0-f9498ec3d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Volume 5c82f103-dae4-42be-9cdc-13ee6a29f48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d', 'volume_size': 1} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.info" returned: 0 in 0.707s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.820s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1828374523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c82f103-dae4-42be-9cdc-13ee6a29f48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:23Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Creating volume 5c82f103-dae4-42be-9cdc-13ee6a29f48d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:23 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:23 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d 1073741824 Sep 28 17:11:23 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cb78c0f8-37e1-4967-85e3-554ba4bb0a92 tempest-VolumesSnapshotTestJSON-1164827402 None] Create snapshot completed successfully Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-f81eebd8-8e60-479b-a102-32627f2f78bf-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:24 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d 1073741824" returned: 0 in 0.838s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-f81eebd8-8e60-479b-a102-32627f2f78bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-f81eebd8-8e60-479b-a102-32627f2f78bf" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-f81eebd8-8e60-479b-a102-32627f2f78bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Deleting offline snapshot f81eebd8-8e60-479b-a102-32627f2f78bf of volume a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:11:24 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d Sep 28 17:11:24 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] snapshot_file for this snap is: volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78d4bb-0fc2-4fbc-98a7-401cf1619889]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:24 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf Sep 28 17:11:24 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:25 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d" returned: 0 in 0.489s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00aaf147-a1a9-4ca0-a3e0-f9498ec3d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e5fddc-b42a-4a09-ae97-3516d1ddd83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Volume volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d (5c82f103-dae4-42be-9cdc-13ee6a29f48d): created successfully Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e5fddc-b42a-4a09-ae97-3516d1ddd83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (76637ec8-1fc8-4f27-ae84-ff4c28cce2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0e0a4754-6c27-418f-8c35-37dcb58f14ae tempest-AttachVolumeNegativeTest-2033009855 None] Created volume successfully. Sep 28 17:11:25 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf" returned: 0 in 0.797s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d45594-d0ae-4a12-aa10-60c578dadefb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf75f3-ee76-4f7d-b4a1-768e0f640f41]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:25 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb Sep 28 17:11:25 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:26 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb" returned: 0 in 0.729s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:26 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf Sep 28 17:11:26 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:26 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf" returned: 0 in 0.562s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:26 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf Sep 28 17:11:26 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-df7c42db-e833-49c2-b7fd-03bed9e051ee req-84b3d710-e568-47a3-98be-66bcc3eda102 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-df7c42db-e833-49c2-b7fd-03bed9e051ee req-84b3d710-e568-47a3-98be-66bcc3eda102 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-df7c42db-e833-49c2-b7fd-03bed9e051ee req-84b3d710-e568-47a3-98be-66bcc3eda102 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-df7c42db-e833-49c2-b7fd-03bed9e051ee req-84b3d710-e568-47a3-98be-66bcc3eda102 tempest-AttachVolumeNegativeTest-2033009855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddaab277-93ce-4352-81ae-dc0d45f813e8', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:27 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb.f81eebd8-8e60-479b-a102-32627f2f78bf" returned: 0 in 0.514s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-df7c42db-e833-49c2-b7fd-03bed9e051ee req-84b3d710-e568-47a3-98be-66bcc3eda102 tempest-AttachVolumeNegativeTest-2033009855 None] attachment_update completed successfully. Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-f81eebd8-8e60-479b-a102-32627f2f78bf" released by "_delete_snapshot" :: held 2.839s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" released by "delete_snapshot" :: held 2.870s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['5f639677-4dc8-4972-87cd-83c4a64a8c33', '340e2c8b-16bd-4472-a7d2-57c90104238e', '5294149b-e33b-4a07-976e-7609b372f1d1', 'f913de1a-e4aa-444f-995f-e9dc09d91fae'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Delete snapshot completed successfully. Sep 28 17:11:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-05956de0-2735-4fe5-a283-b0e4b84507bf tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-f81eebd8-8e60-479b-a102-32627f2f78bf-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ab646b32-f5c9-42a3-b49d-6bbb572233f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6483f6-7ced-41f3-a93a-5e3295f1ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6483f6-7ced-41f3-a93a-5e3295f1ee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1239238175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7864571-1e7f-4e02-984a-f01c0642d400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:29Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e3b6c-f22c-4bdd-9419-646f83d5aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e3b6c-f22c-4bdd-9419-646f83d5aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c091f6-959c-4486-a456-0f43fcc85107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c091f6-959c-4486-a456-0f43fcc85107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7864571-1e7f-4e02-984a-f01c0642d400', 'volume_name': 'volume-a7864571-1e7f-4e02-984a-f01c0642d400', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6096d9e1-1cfd-4146-bef9-99ea07504fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6096d9e1-1cfd-4146-bef9-99ea07504fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc0711c-eb27-4bb3-9001-14988bb8ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Volume a7864571-1e7f-4e02-984a-f01c0642d400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7864571-1e7f-4e02-984a-f01c0642d400', 'volume_size': 1} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1239238175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7864571-1e7f-4e02-984a-f01c0642d400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:29Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Creating volume a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:28 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:28 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 1073741824 Sep 28 17:11:28 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:29 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 1073741824" returned: 0 in 0.864s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:29 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:11:29 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:30 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 0.486s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc0711c-eb27-4bb3-9001-14988bb8ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7864571-1e7f-4e02-984a-f01c0642d400', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25852b4f-f79d-4351-bd57-7466cc85e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:30 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Volume volume-a7864571-1e7f-4e02-984a-f01c0642d400 (a7864571-1e7f-4e02-984a-f01c0642d400): created successfully Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25852b4f-f79d-4351-bd57-7466cc85e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ab646b32-f5c9-42a3-b49d-6bbb572233f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6e963d31-7dc0-4ae1-80c1-baad5542641d tempest-VolumesSnapshotTestJSON-1164827402 None] Created volume successfully. Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating offline snapshot 2b8efa09-31a3-40c4-8117-a1b40591586f of volume a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62c3ae-3c5a-4f6c-acfc-eac2dc95f7bb]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:31 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:11:31 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:31 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 0.593s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:31 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f 1G Sep 28 17:11:31 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f 1G" returned: 0 in 0.648s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7864571-1e7f-4e02-984a-f01c0642d400 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:32 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7864571-1e7f-4e02-984a-f01c0642d400 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:32 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Flow 'volume_create_manager' (66b26c62-535b-4cd0-8cc5-14224e17fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9fac3-d11a-4caa-b7ac-67eb510b25b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9fac3-d11a-4caa-b7ac-67eb510b25b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034158696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef42862-f52e-417f-8fa0-8aee475e75ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32042e3a46bd43c59cc4a29c2ac75637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:33Z,use_quota=True,user_id='55991571c09040739b3a67f820c73abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e83c52c-62e0-4f6e-87d1-a0239d2132c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e83c52c-62e0-4f6e-87d1-a0239d2132c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839bb5bf-1521-45c5-95b0-a298f952275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839bb5bf-1521-45c5-95b0-a298f952275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef42862-f52e-417f-8fa0-8aee475e75ce', 'volume_name': 'volume-2ef42862-f52e-417f-8fa0-8aee475e75ce', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae278cb4-0c0b-44cc-8263-c59bbc5e4d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae278cb4-0c0b-44cc-8263-c59bbc5e4d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c72ce5-c27c-40b6-bbd8-b48b4af4c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Volume 2ef42862-f52e-417f-8fa0-8aee475e75ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef42862-f52e-417f-8fa0-8aee475e75ce', 'volume_size': 1} Sep 28 17:11:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:33 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7864571-1e7f-4e02-984a-f01c0642d400 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 0.483s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:33 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f is being set with open permissions: ugo+rw Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:33 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:33 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:33 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 0.393s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:33 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info Sep 28 17:11:33 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Flow 'volume_create_manager' (49bc4ab6-fca9-45ac-82b7-5a17fa02ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4032c34e-3397-4791-8ec5-dd6950c201fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4032c34e-3397-4791-8ec5-dd6950c201fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2042321330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3de454-9890-4de4-9d6d-5d22aee30f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0ffd9e759a468fb37a3b515f067a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:34Z,use_quota=True,user_id='68165f3f00d842d6a6431584a5bc6ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c11bff-4a9f-42cd-ab82-c80fd7e35da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c11bff-4a9f-42cd-ab82-c80fd7e35da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18b9d8f-3d4d-4459-af25-a7f6e587a969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18b9d8f-3d4d-4459-af25-a7f6e587a969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3de454-9890-4de4-9d6d-5d22aee30f6e', 'volume_name': 'volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3ccd51-40da-411d-9a7e-cc0e4d63d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3ccd51-40da-411d-9a7e-cc0e4d63d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:33 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080f1c56-c0c3-4cc6-bc22-ce9612a114a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Volume 1a3de454-9890-4de4-9d6d-5d22aee30f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e', 'volume_size': 1} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:33 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info is being set with open permissions: ugo+rw Sep 28 17:11:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:33 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info Sep 28 17:11:33 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:34 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.info" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034158696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef42862-f52e-417f-8fa0-8aee475e75ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32042e3a46bd43c59cc4a29c2ac75637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:33Z,use_quota=True,user_id='55991571c09040739b3a67f820c73abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Creating volume 2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:34 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce 1073741824 Sep 28 17:11:34 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d275f8d1-a005-4b3f-abee-13554ebfcac9 tempest-VolumesSnapshotTestJSON-1164827402 None] Create snapshot completed successfully Sep 28 17:11:34 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce 1073741824" returned: 0 in 0.562s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:34 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:11:34 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:35 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.414s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2042321330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3de454-9890-4de4-9d6d-5d22aee30f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0ffd9e759a468fb37a3b515f067a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:34Z,use_quota=True,user_id='68165f3f00d842d6a6431584a5bc6ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Creating volume 1a3de454-9890-4de4-9d6d-5d22aee30f6e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:35 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c72ce5-c27c-40b6-bbd8-b48b4af4c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef42862-f52e-417f-8fa0-8aee475e75ce', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a086191d-9cf1-492b-b1e2-5a03d873e6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e 1073741824 Sep 28 17:11:35 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ac87b73e-fc92-4c8d-a91f-9e4c82ed69f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4a1bce-cc8e-4adc-996e-173aba54a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Volume volume-2ef42862-f52e-417f-8fa0-8aee475e75ce (2ef42862-f52e-417f-8fa0-8aee475e75ce): created successfully Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a086191d-9cf1-492b-b1e2-5a03d873e6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Flow 'volume_create_manager' (66b26c62-535b-4cd0-8cc5-14224e17fd17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4a1bce-cc8e-4adc-996e-173aba54a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1953381303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2b8efa09-31a3-40c4-8117-a1b40591586f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:35Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05b71b-dc76-4506-b410-af3d497d859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db05b71b-dc76-4506-b410-af3d497d859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baeda85-6238-4667-ace5-5f6d748269be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5baeda85-6238-4667-ace5-5f6d748269be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee', 'volume_name': 'volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee', 'volume_size': 2, 'snapshot_id': '2b8efa09-31a3-40c4-8117-a1b40591586f'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718adaae-1a90-4a5f-b0da-191ed8f028d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718adaae-1a90-4a5f-b0da-191ed8f028d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f965ffa1-5e08-4eda-9b96-66b525709c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume 1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee', 'volume_size': 2, 'snapshot_id': '2b8efa09-31a3-40c4-8117-a1b40591586f'} Sep 28 17:11:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bbcd730f-438f-4763-918e-f735b806346f tempest-VolumesActionsTest-2081417747 None] Created volume successfully. Sep 28 17:11:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:36 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e 1073741824" returned: 0 in 0.779s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:36 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e Sep 28 17:11:36 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:36 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e" returned: 0 in 0.414s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080f1c56-c0c3-4cc6-bc22-ce9612a114a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecad0c7-5b4a-4383-90cf-8940ad5f5e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating volume 1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee from snapshot 2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Volume volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e (1a3de454-9890-4de4-9d6d-5d22aee30f6e): created successfully Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecad0c7-5b4a-4383-90cf-8940ad5f5e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Flow 'volume_create_manager' (49bc4ab6-fca9-45ac-82b7-5a17fa02ad04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] snapshot: 2b8efa09-31a3-40c4-8117-a1b40591586f, volume: 1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:11:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0d30be87-3682-4059-a266-1b3aa3e01e87 tempest-AbsoluteLimitsTests-1059594273 None] Created volume successfully. Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[75169d8a-e2ba-49c8-bf4a-133b391fb1c3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:37 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Acquiring lock "cinder-1a3de454-9890-4de4-9d6d-5d22aee30f6e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "cinder-1a3de454-9890-4de4-9d6d-5d22aee30f6e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:37 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 0.935s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7864571-1e7f-4e02-984a-f01c0642d400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Acquiring lock "cinder-quobyte-1a3de454-9890-4de4-9d6d-5d22aee30f6e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca66938-9e26-4bb0-81e0-2d96ea90fc52]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "cinder-quobyte-1a3de454-9890-4de4-9d6d-5d22aee30f6e" acquired by "delete_volume" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c559cc-d499-4f26-8880-02778fd3a2fc]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:11:37 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e Sep 28 17:11:38 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 0.690s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:38 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e" returned: 0 in 0.681s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:38 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee Sep 28 17:11:38 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e Sep 28 17:11:38 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1a3de454-9890-4de4-9d6d-5d22aee30f6e" returned: 0 in 0.450s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "cinder-quobyte-1a3de454-9890-4de4-9d6d-5d22aee30f6e" released by "delete_volume" :: held 1.201s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Created reservations ['d3f3ba17-8a59-476b-b364-ae6ba65e83ec', 'c9066db4-5a8b-49b3-9c5a-bb159a728bc0', '030a38a6-aa48-4f1f-950a-c43b9fbcaf6b', '3410be54-9aae-4e66-a9a6-92ccd1cece0f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:39 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:11:39 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:40 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 1.102s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Deleted volume successfully. Sep 28 17:11:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc980ec4-523a-4643-8368-faff951e654b tempest-AbsoluteLimitsTests-1059594273 None] Lock "cinder-1a3de454-9890-4de4-9d6d-5d22aee30f6e-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:49 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=52,cinder:INSERT=16,cinder:UPDATE=56,cinder:DELETE=7 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:49 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" returned: 0 in 11.131s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:49 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400, size 1024.00 MB, duration 11.13 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:49 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Converted 1024.00 MB image at 91.98 MB/s Sep 28 17:11:49 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee is being set with open permissions: ugo+rw Sep 28 17:11:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee Sep 28 17:11:49 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" returned: 0 in 0.375s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" released by "_copy_volume_from_snapshot" :: held 13.334s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" released by "_create_volume_from_snapshot" :: held 13.482s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.541s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f965ffa1-5e08-4eda-9b96-66b525709c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee', 'volume_size': 2, 'snapshot_id': '2b8efa09-31a3-40c4-8117-a1b40591586f'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472a5875-5183-4745-80c6-575cbf165d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee (1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee): created successfully Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472a5875-5183-4745-80c6-575cbf165d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ac87b73e-fc92-4c8d-a91f-9e4c82ed69f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-96d29b98-fdfa-456b-8e18-96a216f55962 tempest-VolumesSnapshotTestJSON-1164827402 None] Created volume successfully. Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c0ea8-78e2-4a05-81a0-0b084fc720e6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee Sep 28 17:11:51 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" returned: 0 in 1.083s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee Sep 28 17:11:51 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" returned: 0 in 0.663s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee" released by "delete_volume" :: held 1.917s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['28972c88-f83f-4d46-9e4b-639de59a939f', '2f885a8b-7f65-42c0-81d1-39630ff2e0d0', 'c8096ce3-f9af-4dba-9701-e25a5b599b72', 'cefb5154-bd47-4d54-ab76-ca2bbe38be37'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:53 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:11:53 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:53 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.651s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Deleted volume successfully. Sep 28 17:11:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1aa0365-d6d4-404f-9610-cc267d1539d0 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-1bebcb5b-cc38-4edf-b9e2-0fb3acd33cee-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-2b8efa09-31a3-40c4-8117-a1b40591586f-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-2b8efa09-31a3-40c4-8117-a1b40591586f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Deleting offline snapshot 2b8efa09-31a3-40c4-8117-a1b40591586f of volume a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] snapshot_file for this snap is: volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3733587-2272-406a-ba10-4897efd1783c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:54 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 0.984s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7864571-1e7f-4e02-984a-f01c0642d400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ab6ec-e95b-4968-bde2-cf028e8bb1d0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:56 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:11:56 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 1.477s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:57 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0f60f6f-61be-41db-b1fe-5ca36d61620e tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" by "attach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0f60f6f-61be-41db-b1fe-5ca36d61620e tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" acquired by "attach_volume" :: waited 0.074s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d0f60f6f-61be-41db-b1fe-5ca36d61620e tempest-VolumesActionsTest-2081417747 None] Attaching volume 2ef42862-f52e-417f-8fa0-8aee475e75ce to instance e08733ab-6046-401d-9291-5e11054b4bed at mountpoint /dev/vdb on host None. Sep 28 17:11:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d0f60f6f-61be-41db-b1fe-5ca36d61620e tempest-VolumesActionsTest-2081417747 None] Attach volume completed successfully. Sep 28 17:11:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0f60f6f-61be-41db-b1fe-5ca36d61620e tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" released by "attach_volume" :: held 0.318s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d210af93-2120-4fb6-9b58-c855ad2a6df2 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" by "detach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d210af93-2120-4fb6-9b58-c855ad2a6df2 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d210af93-2120-4fb6-9b58-c855ad2a6df2 tempest-VolumesActionsTest-2081417747 None] Detaching volume 2ef42862-f52e-417f-8fa0-8aee475e75ce from instance e08733ab-6046-401d-9291-5e11054b4bed. Sep 28 17:11:58 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 1.389s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f Sep 28 17:11:58 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d210af93-2120-4fb6-9b58-c855ad2a6df2 tempest-VolumesActionsTest-2081417747 None] Detach volume completed successfully. Sep 28 17:11:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d210af93-2120-4fb6-9b58-c855ad2a6df2 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" released by "detach_volume" :: held 0.224s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:59 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400.2b8efa09-31a3-40c4-8117-a1b40591586f" returned: 0 in 0.575s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-2b8efa09-31a3-40c4-8117-a1b40591586f" released by "_delete_snapshot" :: held 4.797s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" released by "delete_snapshot" :: held 4.856s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['496b8e97-4d04-43a4-a788-b6b5d36b72fd', '42a8cd10-1dc6-48bc-9969-c0a1b326c8b6', 'ea02298e-a305-414b-921e-0d91eb4a2a26', '1469e366-7837-4d24-a1d9-f0f31b7e7f61'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=83,cinder:INSERT=25,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Delete snapshot completed successfully. Sep 28 17:11:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7785fce5-271b-43f3-b77c-4dcc1b44c9e3 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-2b8efa09-31a3-40c4-8117-a1b40591586f-delete_snapshot" released by "delete_snapshot" :: held 5.494s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-a7864571-1e7f-4e02-984a-f01c0642d400-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a7864571-1e7f-4e02-984a-f01c0642d400-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb944216-ae52-413b-9597-a295bb885dbd]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:00 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:12:00 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Flow 'volume_create_manager' (b6a4f1cc-290d-4bd2-a126-b87f13fafa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:01 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacad900-4cb0-4760-b801-a80f12ec10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 0.966s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacad900-4cb0-4760-b801-a80f12ec10ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-413765405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ec0520-235b-4575-b968-2b5ccbdb0343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7c8712eb394da3914783a928dfa644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:01Z,use_quota=True,user_id='b2ab05c1fe1a4240ae1f0b530cf65862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd34592-be47-4892-92c2-b2b28451b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400 Sep 28 17:12:01 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd34592-be47-4892-92c2-b2b28451b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcace52a-215d-480d-933e-e213080a63a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcace52a-215d-480d-933e-e213080a63a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ec0520-235b-4575-b968-2b5ccbdb0343', 'volume_name': 'volume-b5ec0520-235b-4575-b968-2b5ccbdb0343', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bac5877-9ce6-43c2-b46b-a10c1ee6813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bac5877-9ce6-43c2-b46b-a10c1ee6813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1bc8ac-8f45-446f-964c-052094b6e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Volume b5ec0520-235b-4575-b968-2b5ccbdb0343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ec0520-235b-4575-b968-2b5ccbdb0343', 'volume_size': 1} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-413765405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ec0520-235b-4575-b968-2b5ccbdb0343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7c8712eb394da3914783a928dfa644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:01Z,use_quota=True,user_id='b2ab05c1fe1a4240ae1f0b530cf65862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Creating volume b5ec0520-235b-4575-b968-2b5ccbdb0343 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:01 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:12:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 1073741824 Sep 28 17:12:01 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:02 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7864571-1e7f-4e02-984a-f01c0642d400" returned: 0 in 0.781s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a7864571-1e7f-4e02-984a-f01c0642d400" released by "delete_volume" :: held 1.994s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['cd466805-7a5b-44a2-8b66-0f9e2a7c5cfd', '7224fa15-3bab-4301-a4e4-002ec84883c0', '9fbe312e-2915-4bdf-bee5-3c23d44c8e80', '0d406203-9b97-4e7b-9f6f-3b343f4d7fc3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:02 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:02 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:02 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:02 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 1073741824" returned: 0 in 1.277s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 Sep 28 17:12:03 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.614s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:03 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.485s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Deleted volume successfully. Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2d3bc7b5-f314-4bb1-9fd6-33a1355ff3f1 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a7864571-1e7f-4e02-984a-f01c0642d400-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:03 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343" returned: 0 in 0.598s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1bc8ac-8f45-446f-964c-052094b6e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ec0520-235b-4575-b968-2b5ccbdb0343', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8105a02-c6ec-4c9f-8e74-755880fb9e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Volume volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 (b5ec0520-235b-4575-b968-2b5ccbdb0343): created successfully Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8105a02-c6ec-4c9f-8e74-755880fb9e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Flow 'volume_create_manager' (b6a4f1cc-290d-4bd2-a126-b87f13fafa1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-50eca060-ec85-469f-b296-b858dd9f9745 tempest-VolumesTransfersTest-1009422891 None] Created volume successfully. Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ed53a45d-afac-4066-acfc-7e27ec260b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e55d4fa-327e-4ce5-9839-b517e624d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e55d4fa-327e-4ce5-9839-b517e624d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605965461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36442836-c471-4819-bde3-079b38284888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e42536-5f35-4458-bbf7-6fe01a0a805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e42536-5f35-4458-bbf7-6fe01a0a805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf5e517-9ea1-48d4-9b80-14ab6f0dee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf5e517-9ea1-48d4-9b80-14ab6f0dee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36442836-c471-4819-bde3-079b38284888', 'volume_name': 'volume-36442836-c471-4819-bde3-079b38284888', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05fee1c-d277-4901-885a-f1b2746d9fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05fee1c-d277-4901-885a-f1b2746d9fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bdd6ad-a360-4ab9-82d8-cacffd8dd3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume 36442836-c471-4819-bde3-079b38284888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36442836-c471-4819-bde3-079b38284888', 'volume_size': 1} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605965461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36442836-c471-4819-bde3-079b38284888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:05Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating volume 36442836-c471-4819-bde3-079b38284888 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:04 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:12:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 1073741824 Sep 28 17:12:04 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:05 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 1073741824" returned: 0 in 1.000s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:06 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:06 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4cd10c36-7bbb-46d5-b2c0-97055d546e9f tempest-VolumesTransfersTest-582667069 None] Transfer volume completed successfully. Sep 28 17:12:06 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 0.561s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40bdd6ad-a360-4ab9-82d8-cacffd8dd3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36442836-c471-4819-bde3-079b38284888', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4a200c-dd4d-494a-8063-4fbce135ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:06 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume volume-36442836-c471-4819-bde3-079b38284888 (36442836-c471-4819-bde3-079b38284888): created successfully Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4a200c-dd4d-494a-8063-4fbce135ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (ed53a45d-afac-4066-acfc-7e27ec260b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-aa62ab93-338c-49b6-8e9d-46a38b2d7461 tempest-VolumesSnapshotTestJSON-1164827402 None] Created volume successfully. Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating offline snapshot d4a99622-4cdd-47b2-9893-430866976f5b of volume 36442836-c471-4819-bde3-079b38284888 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f20a80-e403-4990-a43f-b96c2f6f9fa7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:07 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "cinder-b5ec0520-235b-4575-b968-2b5ccbdb0343-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-b5ec0520-235b-4575-b968-2b5ccbdb0343-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "cinder-quobyte-b5ec0520-235b-4575-b968-2b5ccbdb0343" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-quobyte-b5ec0520-235b-4575-b968-2b5ccbdb0343" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067868a-f4c0-4969-9dc6-3ae73049a271]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 Sep 28 17:12:08 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 0.800s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b 1G Sep 28 17:12:08 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343" returned: 0 in 0.649s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343 Sep 28 17:12:08 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b5ec0520-235b-4575-b968-2b5ccbdb0343" returned: 0 in 0.553s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-quobyte-b5ec0520-235b-4575-b968-2b5ccbdb0343" released by "delete_volume" :: held 1.280s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b 1G" returned: 0 in 0.966s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36442836-c471-4819-bde3-079b38284888 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36442836-c471-4819-bde3-079b38284888 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:09 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Created reservations ['913b34bc-7fa6-445c-9e7e-a0037363bc3d', '6e4005f1-6470-4ffd-a8d2-c8112c97875e', 'a1a032c8-6d97-483c-a755-023c25f3b4cf', '68b44e01-8b65-4e01-8ab8-fa09dd89333e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:09 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36442836-c471-4819-bde3-079b38284888 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.540s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b is being set with open permissions: ugo+rw Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:09 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Deleted volume successfully. Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-371071ba-0372-4129-8c7a-96a656de88a1 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-b5ec0520-235b-4575-b968-2b5ccbdb0343-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info Sep 28 17:12:10 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info is being set with open permissions: ugo+rw Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info Sep 28 17:12:10 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.info" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.454s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a2246bc8-db36-47bc-a5dc-555b75a6bf67 tempest-VolumesSnapshotTestJSON-1164827402 None] Create snapshot completed successfully Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Flow 'volume_create_manager' (90640eaa-8dcb-4191-b22c-1e537767835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df215ab7-9129-4d8b-948f-3d2d01ce20f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df215ab7-9129-4d8b-948f-3d2d01ce20f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-119711314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c7ed6a-f865-4527-ad79-9da334629587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7c8712eb394da3914783a928dfa644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='b2ab05c1fe1a4240ae1f0b530cf65862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6695936c-3af6-4552-ac80-78a8f19adb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6695936c-3af6-4552-ac80-78a8f19adb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b634398-3136-423d-ae25-fd32b851037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b634398-3136-423d-ae25-fd32b851037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c7ed6a-f865-4527-ad79-9da334629587', 'volume_name': 'volume-99c7ed6a-f865-4527-ad79-9da334629587', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cebc58c-712f-4f84-b316-22b2c4aa6930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cebc58c-712f-4f84-b316-22b2c4aa6930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2291eecd-32d6-46cf-811b-34a6fe5e4277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Volume 99c7ed6a-f865-4527-ad79-9da334629587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c7ed6a-f865-4527-ad79-9da334629587', 'volume_size': 1} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-119711314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c7ed6a-f865-4527-ad79-9da334629587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf7c8712eb394da3914783a928dfa644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='b2ab05c1fe1a4240ae1f0b530cf65862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Creating volume 99c7ed6a-f865-4527-ad79-9da334629587 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:10 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:12:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 1073741824 Sep 28 17:12:11 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 1073741824" returned: 0 in 0.684s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 Sep 28 17:12:11 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:12 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2291eecd-32d6-46cf-811b-34a6fe5e4277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c7ed6a-f865-4527-ad79-9da334629587', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbd2faf-9b98-40e3-b61e-59b1a5963238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:12 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Volume volume-99c7ed6a-f865-4527-ad79-9da334629587 (99c7ed6a-f865-4527-ad79-9da334629587): created successfully Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbd2faf-9b98-40e3-b61e-59b1a5963238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Flow 'volume_create_manager' (90640eaa-8dcb-4191-b22c-1e537767835f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-692e6024-2794-4ec2-b8e2-85c71b29f1ec tempest-VolumesTransfersTest-1009422891 None] Created volume successfully. Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (f662ab77-579f-47ee-8dbb-bc1794959b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b5fa1d-1756-42a1-9cec-0a041e4fc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b5fa1d-1756-42a1-9cec-0a041e4fc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1558842271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68bd254-efb9-4cb8-84f7-7e83f6690e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd82d1266ef44888ab6f48be096f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d4a99622-4cdd-47b2-9893-430866976f5b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:13Z,use_quota=True,user_id='d2767b32259a42bf817c77a401f898bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a988e8b-19fa-4995-89d1-a1df40627b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a988e8b-19fa-4995-89d1-a1df40627b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8168f174-2db7-47ab-b80e-9df82d0cf2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8168f174-2db7-47ab-b80e-9df82d0cf2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a68bd254-efb9-4cb8-84f7-7e83f6690e86', 'volume_name': 'volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86', 'volume_size': 1, 'snapshot_id': 'd4a99622-4cdd-47b2-9893-430866976f5b'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8933ffb5-8877-49d7-b3f8-13d2156a97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8933ffb5-8877-49d7-b3f8-13d2156a97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfee7fb9-c8db-4bb5-81d3-fbca1fc317cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:13 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume a68bd254-efb9-4cb8-84f7-7e83f6690e86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86', 'volume_size': 1, 'snapshot_id': 'd4a99622-4cdd-47b2-9893-430866976f5b'} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b-a68bd254-efb9-4cb8-84f7-7e83f6690e86" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b-a68bd254-efb9-4cb8-84f7-7e83f6690e86" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating volume a68bd254-efb9-4cb8-84f7-7e83f6690e86 from snapshot d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] snapshot: d4a99622-4cdd-47b2-9893-430866976f5b, volume: a68bd254-efb9-4cb8-84f7-7e83f6690e86, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f854bdce-3a13-46c0-a227-3ad56c54a7a7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:13 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "cinder-99c7ed6a-f865-4527-ad79-9da334629587-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-99c7ed6a-f865-4527-ad79-9da334629587-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "cinder-quobyte-99c7ed6a-f865-4527-ad79-9da334629587" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-quobyte-99c7ed6a-f865-4527-ad79-9da334629587" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1465b3e-f686-40f0-b54b-4abe80c432df]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.732s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36442836-c471-4819-bde3-079b38284888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[68230328-2ebf-4483-8b68-e324e1247dd1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 Sep 28 17:12:14 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:14 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 0.525s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587" returned: 0 in 0.636s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 Sep 28 17:12:14 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587 Sep 28 17:12:14 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-99c7ed6a-f865-4527-ad79-9da334629587" returned: 0 in 0.304s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-quobyte-99c7ed6a-f865-4527-ad79-9da334629587" released by "delete_volume" :: held 1.001s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Created reservations ['a03e5e76-642a-4f58-a674-318397115325', 'e5228166-3c55-4961-a0ff-cc43d1bcb848', '2ebc6771-b12d-4d36-8585-1cd9ad229dce', '335c58db-188f-4466-af0e-9869dde2512e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:15 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.428s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Deleted volume successfully. Sep 28 17:12:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c88cdcac-3960-4005-86d1-30b4d3733f92 tempest-VolumesTransfersTest-841180609 None] Lock "cinder-99c7ed6a-f865-4527-ad79-9da334629587-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0621365-fb5d-4e11-bd2a-e32b7169bbfd tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" by "attach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0621365-fb5d-4e11-bd2a-e32b7169bbfd tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" acquired by "attach_volume" :: waited 0.091s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:18 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d0621365-fb5d-4e11-bd2a-e32b7169bbfd tempest-VolumesActionsTest-2081417747 None] Attaching volume 2ef42862-f52e-417f-8fa0-8aee475e75ce to instance 0b6ce593-9090-4777-ad8e-501b409fee0f at mountpoint /dev/vdb on host None. Sep 28 17:12:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d0621365-fb5d-4e11-bd2a-e32b7169bbfd tempest-VolumesActionsTest-2081417747 None] Attach volume completed successfully. Sep 28 17:12:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d0621365-fb5d-4e11-bd2a-e32b7169bbfd tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce" released by "attach_volume" :: held 0.409s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-63e96319-c218-41d0-9b13-0c6861923f0d tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" by "detach_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-63e96319-c218-41d0-9b13-0c6861923f0d tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-63e96319-c218-41d0-9b13-0c6861923f0d tempest-VolumesActionsTest-2081417747 None] Detaching volume 2ef42862-f52e-417f-8fa0-8aee475e75ce from instance 0b6ce593-9090-4777-ad8e-501b409fee0f. Sep 28 17:12:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-63e96319-c218-41d0-9b13-0c6861923f0d tempest-VolumesActionsTest-2081417747 None] Detach volume completed successfully. Sep 28 17:12:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-63e96319-c218-41d0-9b13-0c6861923f0d tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-detach_volume" released by "detach_volume" :: held 0.430s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:27 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86" returned: 0 in 13.180s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:27 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888, size 1024.00 MB, duration 13.18 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:12:27 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Converted 1024.00 MB image at 77.69 MB/s Sep 28 17:12:27 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 is being set with open permissions: ugo+rw Sep 28 17:12:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:27 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 Sep 28 17:12:27 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:28 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" released by "_copy_volume_from_snapshot" :: held 15.053s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b-a68bd254-efb9-4cb8-84f7-7e83f6690e86" released by "_create_volume_from_snapshot" :: held 15.163s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.186s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfee7fb9-c8db-4bb5-81d3-fbca1fc317cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86', 'volume_size': 1, 'snapshot_id': 'd4a99622-4cdd-47b2-9893-430866976f5b'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6edd092-604d-4c74-8178-10140ef3dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Volume volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 (a68bd254-efb9-4cb8-84f7-7e83f6690e86): created successfully Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6edd092-604d-4c74-8178-10140ef3dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Flow 'volume_create_manager' (f662ab77-579f-47ee-8dbb-bc1794959b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ab4afda0-a748-40e0-96ab-48c638d478c8 tempest-VolumesSnapshotTestJSON-1164827402 None] Created volume successfully. Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-a68bd254-efb9-4cb8-84f7-7e83f6690e86-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a68bd254-efb9-4cb8-84f7-7e83f6690e86-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" acquired by "delete_volume" :: waited 0.043s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5851b-f0ff-426a-93e0-95afa1bbe6a0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 Sep 28 17:12:30 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86" returned: 0 in 0.582s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86 Sep 28 17:12:30 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a68bd254-efb9-4cb8-84f7-7e83f6690e86" returned: 0 in 0.291s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a68bd254-efb9-4cb8-84f7-7e83f6690e86" released by "delete_volume" :: held 0.968s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['16ab0070-4cdf-410e-8ae4-8ab94cc91865', '1d6ddab8-8aed-477b-beed-3507cafe5e57', '4ccd4020-9750-459e-848e-05cc5c8b3db8', 'cb2a8023-ceb0-414a-8951-e1e0f3c4e333'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:31 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Deleted volume successfully. Sep 28 17:12:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9807567c-3885-4b06-a7cf-c28de14f5179 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a68bd254-efb9-4cb8-84f7-7e83f6690e86-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-d4a99622-4cdd-47b2-9893-430866976f5b-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-d4a99622-4cdd-47b2-9893-430866976f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Deleting offline snapshot d4a99622-4cdd-47b2-9893-430866976f5b of volume 36442836-c471-4819-bde3-079b38284888 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] snapshot_file for this snap is: volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[830b41eb-0cbd-4971-9415-73f80ef35256]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:32 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:32 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.580s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36442836-c471-4819-bde3-079b38284888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206ffbc-e745-4753-a8dc-1f95b9688dd8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7871a39-44fe-49a5-a7c1-43e895d5f261]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:33 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:12:33 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.533s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27dcf87-1549-4dd3-9b3a-0b58fe5887fe]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:12:33 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 0.892s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:33 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-c8386761-3d9b-4244-9e36-c6ccf520d27c req-2dea0d82-3547-4b9e-8072-f4555013e4fb tempest-AttachVolumeNegativeTest-2033009855 None] Terminate volume connection completed successfully. Sep 28 17:12:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-c8386761-3d9b-4244-9e36-c6ccf520d27c req-2dea0d82-3547-4b9e-8072-f4555013e4fb tempest-AttachVolumeNegativeTest-2033009855 None] Deleting attachment ddaab277-93ce-4352-81ae-dc0d45f813e8. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:12:34 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.717s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.f65aaca3-3d7a-46f7-8f71-365fbf48c0da52o_5cf1.img {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.f65aaca3-3d7a-46f7-8f71-365fbf48c0da52o_5cf1.img Sep 28 17:12:34 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.762s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b Sep 28 17:12:34 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888.d4a99622-4cdd-47b2-9893-430866976f5b" returned: 0 in 0.658s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-d4a99622-4cdd-47b2-9893-430866976f5b" released by "_delete_snapshot" :: held 3.226s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" released by "delete_snapshot" :: held 3.264s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['6ec467cf-1162-462b-ab3e-6f75f8f9917d', 'bbaf71ef-33ee-4ab5-ac4f-79db08be21c3', '562085bc-1bc0-4e49-8ae3-025b722be9cb', '4ec445a8-c028-40e0-828f-881aac4460fd'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Delete snapshot completed successfully. Sep 28 17:12:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4e1da8bf-709a-4ad0-b305-5d593d02b1fa tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-d4a99622-4cdd-47b2-9893-430866976f5b-delete_snapshot" released by "delete_snapshot" :: held 3.694s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-36442836-c471-4819-bde3-079b38284888-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-36442836-c471-4819-bde3-079b38284888-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2ac5ac-99e9-4e41-a032-27fbc1a85591]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:37 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 1.180s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888 Sep 28 17:12:38 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-36442836-c471-4819-bde3-079b38284888" returned: 0 in 0.522s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-36442836-c471-4819-bde3-079b38284888" released by "delete_volume" :: held 1.926s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['f985a89e-931f-4b2c-8b49-8456369a4dda', 'a1e12a46-c7c1-485e-96ed-2645fdb3064e', '02f5026d-139d-4f5e-a45a-4052e25eb723', '5e8ecee7-9542-4489-ab99-4dc91d793ca6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:39 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-a1d45594-d0ae-4a12-aa10-60c578dadefb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a1d45594-d0ae-4a12-aa10-60c578dadefb-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Deleted volume successfully. Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8148c093-322b-4b7d-bd25-9f72d1a5d125 tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-36442836-c471-4819-bde3-079b38284888-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c912905-bda0-4d82-80f4-4907ecf90632]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb Sep 28 17:12:40 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb" returned: 0 in 1.065s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb Sep 28 17:12:41 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a1d45594-d0ae-4a12-aa10-60c578dadefb" returned: 0 in 0.713s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-quobyte-a1d45594-d0ae-4a12-aa10-60c578dadefb" released by "delete_volume" :: held 2.046s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Created reservations ['4d268a9b-34b7-44b2-8bf0-14063ce4dec4', 'fe33fbeb-bb76-44e7-9136-1015b8d61cff', 'eb532486-ecc4-4ae6-883c-56a3f18d5873', 'f11f9ecf-d909-4533-883f-15645230fe09'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:12:42 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.416s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Deleted volume successfully. Sep 28 17:12:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a69f773a-74f6-4e2b-86c1-964eea2c74eb tempest-VolumesSnapshotTestJSON-1164827402 None] Lock "cinder-a1d45594-d0ae-4a12-aa10-60c578dadefb-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:44 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.f65aaca3-3d7a-46f7-8f71-365fbf48c0da52o_5cf1.img" returned: 0 in 10.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c3dcb6-ddd9-4735-8555-a356b89ea28e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:12:44 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.746s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce, size 1024.00 MB, duration 10.36 sec, destination /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.f65aaca3-3d7a-46f7-8f71-365fbf48c0da52o_5cf1.img {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:12:45 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Converted 1024.00 MB image at 98.79 MB/s Sep 28 17:12:45 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] f65aaca3-3d7a-46f7-8f71-365fbf48c0da was raw, no need to convert to raw {{(pid=87034) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:12:52 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=77,cinder:SELECT=54,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:55 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=87,cinder:SELECT=84,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:13:02 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Flow 'volume_create_manager' (9bf6e041-eeb1-4f0c-95a9-7fc4d44e69ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d42182-3a9b-4b0a-aff0-78c7446a00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d42182-3a9b-4b0a-aff0-78c7446a00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-753362041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420848e4-44d4-4f20-84b2-fbdf17adba80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05123c26d9fd4cb18ca87b98500975ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='1fe591446b30435fb075447d9b4aad21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6a653a-a518-4ebc-9a0e-5baff906b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6a653a-a518-4ebc-9a0e-5baff906b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f90df9-a386-476b-9172-da7be8bb42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f90df9-a386-476b-9172-da7be8bb42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420848e4-44d4-4f20-84b2-fbdf17adba80', 'volume_name': 'volume-420848e4-44d4-4f20-84b2-fbdf17adba80', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc885f8-7085-4aed-8db4-2b5c8cdd1056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc885f8-7085-4aed-8db4-2b5c8cdd1056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1b3b10-4e60-40be-b915-96b229b4fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Volume 420848e4-44d4-4f20-84b2-fbdf17adba80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420848e4-44d4-4f20-84b2-fbdf17adba80', 'volume_size': 1} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:03 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.728s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:12 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:13 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.698s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Uploaded volume to glance image-id: f65aaca3-3d7a-46f7-8f71-365fbf48c0da. {{(pid=87034) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.724s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-753362041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420848e4-44d4-4f20-84b2-fbdf17adba80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05123c26d9fd4cb18ca87b98500975ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='1fe591446b30435fb075447d9b4aad21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Creating volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:19 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:13:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-16760f0a-841a-43d6-8a04-3f8c9f54ccb6 tempest-VolumesActionsTest-2081417747 None] Copy volume to image completed successfully. Sep 28 17:13:19 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 1073741824 Sep 28 17:13:19 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 1073741824" returned: 0 in 0.811s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 Sep 28 17:13:20 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80" returned: 0 in 0.369s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1b3b10-4e60-40be-b915-96b229b4fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420848e4-44d4-4f20-84b2-fbdf17adba80', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9f73d-f1c5-4a85-b342-a5ad998c4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Volume volume-420848e4-44d4-4f20-84b2-fbdf17adba80 (420848e4-44d4-4f20-84b2-fbdf17adba80): created successfully Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9f73d-f1c5-4a85-b342-a5ad998c4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Flow 'volume_create_manager' (9bf6e041-eeb1-4f0c-95a9-7fc4d44e69ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bcb03ca3-2842-4e09-8008-8499e6f0d342 tempest-VolumesSnapshotListTestJSON-252768620 None] Created volume successfully. Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Creating offline snapshot e124d523-7460-4692-8918-56ad26feccb2 of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f366b2d-8f26-4a67-96dd-2a3fce942ecb]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 Sep 28 17:13:22 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:22 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80" returned: 0 in 0.589s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 1G Sep 28 17:13:22 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 1G" returned: 0 in 0.573s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:23 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.415s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 is being set with open permissions: ugo+rw Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:23 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Flow 'volume_create_manager' (f634e234-fc1b-47a2-85c3-f73ba2ea32b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de993368-574f-4b15-af7f-6db88c27f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de993368-574f-4b15-af7f-6db88c27f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2047606320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68082509-ca33-4819-b0ce-1a3cd4efdfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5df4eb06734cd9ba636b18cae06683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:24Z,use_quota=True,user_id='d6dac7aaf2ce43689a82b0fbdfad75b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0246f3-730e-4567-a559-e17b0eeb4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0246f3-730e-4567-a559-e17b0eeb4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aced680c-8d87-42af-8731-5a87c62f17ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:13:23 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info Sep 28 17:13:23 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info" returned: 0 in 0.330s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info is being set with open permissions: ugo+rw Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info Sep 28 17:13:24 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aced680c-8d87-42af-8731-5a87c62f17ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'volume_name': 'volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefcacd-5553-4988-bc47-60bafb83e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefcacd-5553-4988-bc47-60bafb83e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41becf8-f447-4095-9f75-74423129334f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Trying to clone 68082509-ca33-4819-b0ce-1a3cd4efdfe4 from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:13:24 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.info" returned: 0 in 0.351s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.519s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46a4b39-de02-4b71-a7d0-4a0ea151a99d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-65d80b23-6149-4533-9b0a-7c495becefa1 tempest-VolumesSnapshotListTestJSON-252768620 None] Create snapshot completed successfully Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:13:24 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:13:24 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:13:24 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0225f5-9de8-478f-9cd0-da9eeb9b37c4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD Sep 28 17:13:25 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.516s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5251d3e-6128-4183-a101-2930381d21ec]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:25 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:13:25 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef is fetched for user d6dac7aaf2ce43689a82b0fbdfad75b0. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[762da10b-85a1-47ef-bd1d-fedd09445f23]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD Sep 28 17:13:25 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.585s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:25 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img Sep 28 17:13:25 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:26 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img" returned: 0 in 7.361s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86a827-68e6-4d56-a2f2-acc4ff61b7ad]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:13:33 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.550s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:33 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Converted 1024.00 MB image at 139.08 MB/s Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] da2a716c-134e-4be6-805c-34139ed48b3c was raw, converting to qcow2 {{(pid=87034) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0855102e-25ca-47dc-aea5-1f19b1040e02]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img Sep 28 17:13:33 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img" returned: 0 in 0.447s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img Sep 28 17:13:34 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img" returned: 1 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img /opt/stack/data/cinder/conversion/vol_upload_f85nawiy {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img /opt/stack/data/cinder/conversion/vol_upload_f85nawiy Sep 28 17:13:34 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img /opt/stack/data/cinder/conversion/vol_upload_f85nawiy" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Image conversion details: src /opt/stack/data/cinder/conversion/2ef42862-f52e-417f-8fa0-8aee475e75ce.temp_image.da2a716c-134e-4be6-805c-34139ed48b3c4eue24co.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f85nawiy {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:34 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5998ff2c-a81e-4ded-8a4d-4e289b227fbf]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f85nawiy {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f85nawiy Sep 28 17:13:35 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f85nawiy" returned: 0 in 0.421s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.620s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Uploaded volume to glance image-id: da2a716c-134e-4be6-805c-34139ed48b3c. {{(pid=87034) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.870s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Creating offline snapshot 6cb2aae0-a60a-4a83-a454-91fb018e675f of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-533a8167-5df8-4454-99bd-3fbb601fa749 tempest-VolumesActionsTest-2081417747 None] Copy volume to image completed successfully. Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef3817d-f310-4464-a2db-6e7178d1b85c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:37 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.580s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f 1G Sep 28 17:13:37 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (0a574dc0-f7d0-42dd-ae68-45cbac9a4799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1292ca-9ca7-457d-ad04-6dc3e59666e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1292ca-9ca7-457d-ad04-6dc3e59666e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2023395402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:38Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e363f4a-35e2-4c70-9e48-4237ed8464a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e363f4a-35e2-4c70-9e48-4237ed8464a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aac8161-1517-4580-bf6b-ed6117c570eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aac8161-1517-4580-bf6b-ed6117c570eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e', 'volume_name': 'volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864262c2-dc17-441e-b47b-f24fac47b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864262c2-dc17-441e-b47b-f24fac47b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bb1af-81f0-450f-8c7c-1c2b0eddc9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Volume 80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e', 'volume_size': 1} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:38 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f 1G" returned: 0 in 0.641s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:38 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "cinder-quobyte-2ef42862-f52e-417f-8fa0-8aee475e75ce" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-quobyte-2ef42862-f52e-417f-8fa0-8aee475e75ce" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0abe0ef-f0c1-4f91-8590-9a004e6024e3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.420s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f is being set with open permissions: ugo+rw Sep 28 17:13:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:39 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:13:39 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.305s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.288s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2047606320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68082509-ca33-4819-b0ce-1a3cd4efdfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5df4eb06734cd9ba636b18cae06683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:24Z,use_quota=True,user_id='d6dac7aaf2ce43689a82b0fbdfad75b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Creating volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:39 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1073741824 Sep 28 17:13:39 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-465f8a3b-b572-4c7a-b4f2-e57166119e93 tempest-VolumesSnapshotListTestJSON-252768620 None] Create snapshot completed successfully Sep 28 17:13:39 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.463s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce Sep 28 17:13:39 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2ef42862-f52e-417f-8fa0-8aee475e75ce" returned: 0 in 0.356s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-quobyte-2ef42862-f52e-417f-8fa0-8aee475e75ce" released by "delete_volume" :: held 0.869s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Created reservations ['2a6c0e4c-1fb9-45b2-a518-8f48a6dd2ad0', '6ccd025b-82fd-49da-abf8-0cfef69cb424', '58a29496-acc8-4608-841c-efc6aad8c4de', '7167cbe3-3344-4935-8426-1588d7333073'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:39 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1073741824" returned: 0 in 0.538s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 Sep 28 17:13:40 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:13:40 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4" returned: 0 in 0.370s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.282s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2023395402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:38Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Creating volume 80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:40 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.375s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:40 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e 1073741824 Sep 28 17:13:40 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Deleted volume successfully. Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Attempting download of 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-87b7b74a-8ed0-4f03-8788-8b892bf28dc8 tempest-VolumesActionsTest-2081417747 None] Lock "cinder-2ef42862-f52e-417f-8fa0-8aee475e75ce-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d3625-9ab0-4a52-bcd7-a64a2256facf]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:40 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a Sep 28 17:13:40 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e 1073741824" returned: 0 in 0.631s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e Sep 28 17:13:41 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a" returned: 0 in 0.480s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a Sep 28 17:13:41 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" returned: 0 in 0.408s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.802s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680bb1af-81f0-450f-8c7c-1c2b0eddc9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862f9d12-fed4-4326-8435-5a5807e007fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Creating offline snapshot 74af6946-523d-4c99-ba8d-dabd983a2667 of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:41 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Volume volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e (80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e): created successfully Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862f9d12-fed4-4326-8435-5a5807e007fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (0a574dc0-f7d0-42dd-ae68-45cbac9a4799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a9907-83e1-4945-8748-3475d99aedd0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a" returned: 1 in 0.525s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_iyjm0o4a' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a48d7-72fb-45c9-ae50-266bcdffe349]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-215504c1-0999-4676-a259-fc89a2cbcab9 tempest-AttachVolumeNegativeTest-2033009855 None] Created volume successfully. Sep 28 17:13:41 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:41 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD Sep 28 17:13:41 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 Sep 28 17:13:42 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.676s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 1G Sep 28 17:13:42 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 1G" returned: 0 in 0.875s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 Sep 28 17:13:43 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-bfb9bfeb-7466-4e99-86c2-b0541dfda6e3 req-dff370ec-db9f-4694-814e-93f729d5bf90 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:43 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667" returned: 0 in 0.629s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 is being set with open permissions: ugo+rw Sep 28 17:13:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 Sep 28 17:13:43 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-bfb9bfeb-7466-4e99-86c2-b0541dfda6e3 req-dff370ec-db9f-4694-814e-93f729d5bf90 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.454s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-bfb9bfeb-7466-4e99-86c2-b0541dfda6e3 req-dff370ec-db9f-4694-814e-93f729d5bf90 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f3056e19-e112-474b-af70-821d1c0cc763 tempest-VolumesSnapshotListTestJSON-252768620 None] Create snapshot completed successfully Sep 28 17:13:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-bfb9bfeb-7466-4e99-86c2-b0541dfda6e3 req-dff370ec-db9f-4694-814e-93f729d5bf90 tempest-AttachVolumeNegativeTest-2033009855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4d5e1f0-2b4a-4522-bfa2-8f657790f933', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:13:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-bfb9bfeb-7466-4e99-86c2-b0541dfda6e3 req-dff370ec-db9f-4694-814e-93f729d5bf90 tempest-AttachVolumeNegativeTest-2033009855 None] attachment_update completed successfully. Sep 28 17:13:45 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4" returned: 0 in 3.064s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef_makmhgxudevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:45 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Converted 112.00 MB image at 36.54 MB/s Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1G Sep 28 17:13:45 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 1G" returned: 0 in 0.549s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Downloaded image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef ((None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}])) to volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4 successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Temporary image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef for user d6dac7aaf2ce43689a82b0fbdfad75b0 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Marking volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4 as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Copying metadata from image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef to 68082509-ca33-4819-b0ce-1a3cd4efdfe4. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Creating volume glance metadata for volume 68082509-ca33-4819-b0ce-1a3cd4efdfe4 backed by image 0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41becf8-f447-4095-9f75-74423129334f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'volume_size': 1, 'image_id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a297f7bf2c9d4271b07dee47ec5c4412', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a28f1dc-93b7-40a1-b6c0-ba063fe2a1ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0147195-038d-45a9-b5e2-8bc43c723aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:46 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Volume volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 (68082509-ca33-4819-b0ce-1a3cd4efdfe4): created successfully Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0147195-038d-45a9-b5e2-8bc43c723aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Flow 'volume_create_manager' (f634e234-fc1b-47a2-85c3-f73ba2ea32b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:46 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5e279496-16d4-4e0e-abd7-5d86c09bcad3 tempest-TestShelveInstance-1452814021 None] Created volume successfully. Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-74af6946-523d-4c99-ba8d-dabd983a2667-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-74af6946-523d-4c99-ba8d-dabd983a2667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-74af6946-523d-4c99-ba8d-dabd983a2667" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-74af6946-523d-4c99-ba8d-dabd983a2667" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Deleting offline snapshot 74af6946-523d-4c99-ba8d-dabd983a2667 of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] snapshot_file for this snap is: volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcec038-eef5-4fd0-9401-339bcd1ebe89]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 Sep 28 17:13:46 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667" returned: 0 in 0.463s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e7302-dfdd-4006-9d01-20451542b92b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:47 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.748s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 Sep 28 17:13:47 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667" returned: 0 in 0.634s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667 Sep 28 17:13:48 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-5d5e93ca-81e8-4e12-8ccf-b9cb24a925f6 req-743cc254-edfd-4bfa-8bdf-a43cba638f06 tempest-AttachVolumeNegativeTest-2033009855 None] Terminate volume connection completed successfully. Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-5d5e93ca-81e8-4e12-8ccf-b9cb24a925f6 req-743cc254-edfd-4bfa-8bdf-a43cba638f06 tempest-AttachVolumeNegativeTest-2033009855 None] Deleting attachment c4d5e1f0-2b4a-4522-bfa2-8f657790f933. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:13:48 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.74af6946-523d-4c99-ba8d-dabd983a2667" returned: 0 in 0.448s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-74af6946-523d-4c99-ba8d-dabd983a2667" released by "_delete_snapshot" :: held 2.488s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" released by "delete_snapshot" :: held 2.521s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:48 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Created reservations ['095ff6ab-9c0b-473c-a448-cbfdd684bee2', '3b930cc9-fe90-4f74-80a9-5fbc594d32c5', '7c404fe6-ccb0-49f5-ac89-82f5f4f306d7', '2919caee-6415-4cd6-875b-56fabe91c841'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Delete snapshot completed successfully. Sep 28 17:13:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a7c9d07a-4c6c-4568-8be4-b48d5f723ba8 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-74af6946-523d-4c99-ba8d-dabd983a2667-delete_snapshot" released by "delete_snapshot" :: held 2.800s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-6cb2aae0-a60a-4a83-a454-91fb018e675f-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-6cb2aae0-a60a-4a83-a454-91fb018e675f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-6cb2aae0-a60a-4a83-a454-91fb018e675f" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-6cb2aae0-a60a-4a83-a454-91fb018e675f" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Deleting offline snapshot 6cb2aae0-a60a-4a83-a454-91fb018e675f of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] snapshot_file for this snap is: volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[69597572-6c0a-4660-a6c9-3d61d50edffd]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:50 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:50 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:50 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.716s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8dc6e-95cc-403b-b1e7-901c325e3453]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:51 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:51 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.913s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:52 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee63dfba-e32b-4b69-8389-43ce91255630 req-b9a1ceab-1ccc-4661-b995-c373986632b9 tempest-TestShelveInstance-1452814021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee63dfba-e32b-4b69-8389-43ce91255630 req-b9a1ceab-1ccc-4661-b995-c373986632b9 tempest-TestShelveInstance-1452814021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee63dfba-e32b-4b69-8389-43ce91255630 req-b9a1ceab-1ccc-4661-b995-c373986632b9 tempest-TestShelveInstance-1452814021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-ee63dfba-e32b-4b69-8389-43ce91255630 req-b9a1ceab-1ccc-4661-b995-c373986632b9 tempest-TestShelveInstance-1452814021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed63e4a8-cd23-4f78-8835-7b9d728e36c3', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:13:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-ee63dfba-e32b-4b69-8389-43ce91255630 req-b9a1ceab-1ccc-4661-b995-c373986632b9 tempest-TestShelveInstance-1452814021 None] attachment_update completed successfully. Sep 28 17:13:52 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.968s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f Sep 28 17:13:52 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:53 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.6cb2aae0-a60a-4a83-a454-91fb018e675f" returned: 0 in 0.881s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-6cb2aae0-a60a-4a83-a454-91fb018e675f" released by "_delete_snapshot" :: held 3.805s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" released by "delete_snapshot" :: held 3.878s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Created reservations ['30edd9f9-3fb8-45b3-ba94-06f5b3307440', '030c03e3-bef9-46b4-ac6b-208a9b0bcd0e', '22992372-8c41-4c2d-8dd5-a623deac337e', '5970959f-5473-4356-ae64-0fd0bf6f4bc5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Delete snapshot completed successfully. Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-949d684d-b30e-4e5b-8da2-b620faaa29b7 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-6cb2aae0-a60a-4a83-a454-91fb018e675f-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-e124d523-7460-4692-8918-56ad26feccb2-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-e124d523-7460-4692-8918-56ad26feccb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-e124d523-7460-4692-8918-56ad26feccb2" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-e124d523-7460-4692-8918-56ad26feccb2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Deleting offline snapshot e124d523-7460-4692-8918-56ad26feccb2 of volume 420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] snapshot_file for this snap is: volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1747cc8d-00ec-4be8-83d2-37d1039e3e2e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:54 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:54 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:55 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Flow 'volume_create_manager' (f537f524-f230-4a57-9732-efbac6e8e78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3837806-ef24-4284-8759-a81b3a7828fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.805s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420848e4-44d4-4f20-84b2-fbdf17adba80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3837806-ef24-4284-8759-a81b3a7828fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1571490914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa9f24d-a84e-4ce9-82a0-939d9b385f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8041e8956bf1433fb935035481d881ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:55Z,use_quota=True,user_id='32bea2fe726e4676a6bf25c044c40358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27a8756-7bf3-480b-b925-f7554490f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27a8756-7bf3-480b-b925-f7554490f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40ad5ef-f294-451a-a7f6-a68166871faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40ad5ef-f294-451a-a7f6-a68166871faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa9f24d-a84e-4ce9-82a0-939d9b385f8a', 'volume_name': 'volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50030d9-f57d-442e-821a-5158fcba394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50030d9-f57d-442e-821a-5158fcba394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cf622b-6cf4-4484-9524-a5f5875f9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Volume 9aa9f24d-a84e-4ce9-82a0-939d9b385f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a', 'volume_size': 1} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1571490914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa9f24d-a84e-4ce9-82a0-939d9b385f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8041e8956bf1433fb935035481d881ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:55Z,use_quota=True,user_id='32bea2fe726e4676a6bf25c044c40358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Creating volume 9aa9f24d-a84e-4ce9-82a0-939d9b385f8a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:55 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51cae2-5806-4048-af07-0f2af64b97ec]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:55 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a 1073741824 Sep 28 17:13:55 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:55 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 Sep 28 17:13:55 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:56 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a 1073741824" returned: 0 in 0.700s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a Sep 28 17:13:56 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" returned: 0 in 0.407s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cf622b-6cf4-4484-9524-a5f5875f9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba2074a-a593-4013-95f6-e2ca149fc766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:56 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Volume volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a (9aa9f24d-a84e-4ce9-82a0-939d9b385f8a): created successfully Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba2074a-a593-4013-95f6-e2ca149fc766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Flow 'volume_create_manager' (f537f524-f230-4a57-9732-efbac6e8e78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:56 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-011413ad-e570-4b3d-92bd-49c361965018 tempest-VolumesNegativeTest-1789727719 None] Created volume successfully. Sep 28 17:13:56 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.715s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2 Sep 28 17:13:57 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:57 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80.e124d523-7460-4692-8918-56ad26feccb2" returned: 0 in 0.407s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-e124d523-7460-4692-8918-56ad26feccb2" released by "_delete_snapshot" :: held 2.739s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" released by "delete_snapshot" :: held 2.772s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:57 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Created reservations ['40b45097-8ac2-4988-bf61-43bfca5610fb', '69c68d4d-a32c-4b47-96a8-5d0a4310609e', '9bc8ae92-7d09-4e03-8e97-95c1174ce5d4', '882defa9-764f-41f8-b321-631eb2977586'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Delete snapshot completed successfully. Sep 28 17:13:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-715f8cb6-db3b-4471-9a1b-4428b5fec2fc tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-e124d523-7460-4692-8918-56ad26feccb2-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-420848e4-44d4-4f20-84b2-fbdf17adba80-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-420848e4-44d4-4f20-84b2-fbdf17adba80-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d9e604-73d0-460a-a901-e9df3d756f0b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 Sep 28 17:13:58 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80" returned: 0 in 0.947s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80 Sep 28 17:13:59 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-420848e4-44d4-4f20-84b2-fbdf17adba80" returned: 0 in 0.832s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-quobyte-420848e4-44d4-4f20-84b2-fbdf17adba80" released by "delete_volume" :: held 1.919s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Created reservations ['91ea7d51-6429-4e38-bfc3-3bb576fc61f9', '288884d2-a709-4e27-ba87-661ae6e54d9f', '15e211e5-5e4b-42f4-8ae9-fdcb0eaef839', '0cebd951-3860-4581-8d31-cb353419cf28'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:14:00 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.703s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Deleted volume successfully. Sep 28 17:14:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dc8987ea-7e75-4d18-9055-e89188d14fe1 tempest-VolumesSnapshotListTestJSON-252768620 None] Lock "cinder-420848e4-44d4-4f20-84b2-fbdf17adba80-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:14:02 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.422s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:10 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=54,cinder:INSERT=17,cinder:SELECT=63,cinder:DELETE=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:11 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=65,cinder:UPDATE=52,cinder:DELETE=6,cinder:INSERT=21 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:32 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Acquiring lock "cinder-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "cinder-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Acquiring lock "cinder-quobyte-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "cinder-quobyte-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b823a0-0cd3-416b-82b0-b89fe0b6bc66]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a Sep 28 17:14:48 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-5a9835e5-6bf9-4d1a-bbf1-f89f7a8f5f0a req-5f31725f-e85b-4091-b153-2200933ba824 tempest-TestShelveInstance-1452814021 None] Terminate volume connection completed successfully. Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-5a9835e5-6bf9-4d1a-bbf1-f89f7a8f5f0a req-5f31725f-e85b-4091-b153-2200933ba824 tempest-TestShelveInstance-1452814021 None] Deleting attachment ed63e4a8-cd23-4f78-8835-7b9d728e36c3. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:14:48 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" returned: 0 in 0.503s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a Sep 28 17:14:48 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "cinder-quobyte-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a" released by "delete_volume" :: held 0.909s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Created reservations ['c29a3d34-b2fe-4ebf-a299-58888ab2594d', '5b4328fd-9242-4643-9c15-dff6e8ddea2d', 'fa98a0c1-7cbb-4206-b793-05fa44fe7371', '7da8f899-f482-47be-bd11-fb1f9e6ae56b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:14:49 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Deleted volume successfully. Sep 28 17:14:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3803a40-db52-47f4-b8ec-f0510eaf1d3f tempest-VolumesNegativeTest-1789727719 None] Lock "cinder-9aa9f24d-a84e-4ce9-82a0-939d9b385f8a-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-6cfbfe5d-cab8-476f-a906-ec40a03a30f4 req-fcb81839-ad5f-4984-a166-d0acd596bffd tempest-TestShelveInstance-1452814021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-6cfbfe5d-cab8-476f-a906-ec40a03a30f4 req-fcb81839-ad5f-4984-a166-d0acd596bffd tempest-TestShelveInstance-1452814021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-6cfbfe5d-cab8-476f-a906-ec40a03a30f4 req-fcb81839-ad5f-4984-a166-d0acd596bffd tempest-TestShelveInstance-1452814021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-6cfbfe5d-cab8-476f-a906-ec40a03a30f4 req-fcb81839-ad5f-4984-a166-d0acd596bffd tempest-TestShelveInstance-1452814021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe0d99e7-83a4-4792-9b9e-e2ee835ff0d6', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:14:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-6cfbfe5d-cab8-476f-a906-ec40a03a30f4 req-fcb81839-ad5f-4984-a166-d0acd596bffd tempest-TestShelveInstance-1452814021 None] attachment_update completed successfully. Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (f25e257f-a4c4-48d0-983e-98525dab823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5afeeb1-0cf5-435d-afd3-ae01c009f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5afeeb1-0cf5-435d-afd3-ae01c009f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-381494234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada76170-fe46-46b2-b577-ce7cd36af43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:58Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5456e6-c0be-4288-a565-3f14a8d24344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5456e6-c0be-4288-a565-3f14a8d24344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83741169-fd98-4eeb-93aa-23afee510b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83741169-fd98-4eeb-93aa-23afee510b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada76170-fe46-46b2-b577-ce7cd36af43d', 'volume_name': 'volume-ada76170-fe46-46b2-b577-ce7cd36af43d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece1d72-fda2-442b-8756-8ad5b1c1bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece1d72-fda2-442b-8756-8ad5b1c1bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5fe7e2-28c1-4ee9-a5a5-648fc1054692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Volume ada76170-fe46-46b2-b577-ce7cd36af43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada76170-fe46-46b2-b577-ce7cd36af43d', 'volume_size': 1} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-381494234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada76170-fe46-46b2-b577-ce7cd36af43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621eb3daa564473682c1645fa911e9eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:58Z,use_quota=True,user_id='124608bc2f064b35a090165625c56e5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Creating volume ada76170-fe46-46b2-b577-ce7cd36af43d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:58 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:14:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d 1073741824 Sep 28 17:14:58 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d 1073741824" returned: 0 in 0.721s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d Sep 28 17:14:58 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:59 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d" returned: 0 in 0.587s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5fe7e2-28c1-4ee9-a5a5-648fc1054692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada76170-fe46-46b2-b577-ce7cd36af43d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdc1bd-2510-4490-82cb-c8f7d9434d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Volume volume-ada76170-fe46-46b2-b577-ce7cd36af43d (ada76170-fe46-46b2-b577-ce7cd36af43d): created successfully Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdc1bd-2510-4490-82cb-c8f7d9434d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Flow 'volume_create_manager' (f25e257f-a4c4-48d0-983e-98525dab823e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-baa5ac2a-e661-4e61-a2b4-71ab7b2b0889 tempest-AttachVolumeNegativeTest-2033009855 None] Created volume successfully. Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1fc94d06-956d-4712-8ad6-868ecd24b6fc req-052e68a6-6d7b-4142-9315-ec2a1edc2bf5 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1fc94d06-956d-4712-8ad6-868ecd24b6fc req-052e68a6-6d7b-4142-9315-ec2a1edc2bf5 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1fc94d06-956d-4712-8ad6-868ecd24b6fc req-052e68a6-6d7b-4142-9315-ec2a1edc2bf5 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-1fc94d06-956d-4712-8ad6-868ecd24b6fc req-052e68a6-6d7b-4142-9315-ec2a1edc2bf5 tempest-AttachVolumeNegativeTest-2033009855 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-ada76170-fe46-46b2-b577-ce7cd36af43d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7933021-4d03-4f4b-bbe6-a94962388136', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:02 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:15:02 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-1fc94d06-956d-4712-8ad6-868ecd24b6fc req-052e68a6-6d7b-4142-9315-ec2a1edc2bf5 tempest-AttachVolumeNegativeTest-2033009855 None] attachment_update completed successfully. Sep 28 17:15:03 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.715s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-6e34a941-6808-4aa0-998e-493eca20a53d req-b7dade2e-5045-4403-abf9-4e838eaeac38 tempest-AttachVolumeNegativeTest-2033009855 None] Terminate volume connection completed successfully. Sep 28 17:15:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-6e34a941-6808-4aa0-998e-493eca20a53d req-b7dade2e-5045-4403-abf9-4e838eaeac38 tempest-AttachVolumeNegativeTest-2033009855 None] Deleting attachment e7933021-4d03-4f4b-bbe6-a94962388136. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:15:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=21,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-ada76170-fe46-46b2-b577-ce7cd36af43d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-ada76170-fe46-46b2-b577-ce7cd36af43d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-quobyte-ada76170-fe46-46b2-b577-ce7cd36af43d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-ada76170-fe46-46b2-b577-ce7cd36af43d" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8711f1-f901-474f-a9f0-a52d3cf7b1b4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:22 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d Sep 28 17:15:22 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:23 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d" returned: 0 in 1.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d Sep 28 17:15:23 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ada76170-fe46-46b2-b577-ce7cd36af43d" returned: 0 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-ada76170-fe46-46b2-b577-ce7cd36af43d" released by "delete_volume" :: held 1.989s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Created reservations ['35f8ea86-edf5-4d27-b76b-68940d86ff85', 'f7a6f15b-a82d-40f3-a6fe-12d4113b06f1', '2d85f94e-b711-4fc8-804a-e3a8721172e6', '2df561e4-ed27-433e-9d16-0f0d72c11e58'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:15:24 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-quobyte-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:25 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.709s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" acquired by "delete_volume" :: waited 0.071s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Deleted volume successfully. Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dde0bf-0d20-410a-9dbc-be678b12b52d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9bb4291d-4670-4792-a96f-065e7bdf2ea0 tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-ada76170-fe46-46b2-b577-ce7cd36af43d-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e Sep 28 17:15:25 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" returned: 0 in 0.624s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e Sep 28 17:15:26 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" returned: 0 in 0.529s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e" released by "delete_volume" :: held 1.327s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:26 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Created reservations ['ec5175b8-4be6-49f8-b03e-24a713aa04e9', '7c8a9157-6d61-4e1b-a172-6cced056ad40', '35d81c55-7735-41fd-8dab-67d3411a854d', '56ac8a41-3dcb-47f1-926c-15eda29a66cf'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:15:27 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.918s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Deleted volume successfully. Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35a6c273-c7c4-4360-ba49-47e67e466d7c tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-80d2b7e6-8e5a-45c6-bdda-3f3874a1b26e-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-5c82f103-dae4-42be-9cdc-13ee6a29f48d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-5c82f103-dae4-42be-9cdc-13ee6a29f48d-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "cinder-quobyte-5c82f103-dae4-42be-9cdc-13ee6a29f48d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-5c82f103-dae4-42be-9cdc-13ee6a29f48d" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[58726d1b-b372-4608-9e56-ec18a6b496ae]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d Sep 28 17:15:28 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d" returned: 0 in 0.620s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d Sep 28 17:15:29 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5c82f103-dae4-42be-9cdc-13ee6a29f48d" returned: 0 in 0.534s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-quobyte-5c82f103-dae4-42be-9cdc-13ee6a29f48d" released by "delete_volume" :: held 1.247s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Created reservations ['c2e725aa-e6c3-4e89-97ca-acd8fc0120eb', 'efb1df5e-6339-4f70-8e5a-9d41aba53cb8', '374d228e-1d2f-4321-bc4e-5c8e3578ddea', 'e65d8238-1ea6-4213-b226-29f52e303daf'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:15:30 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.455s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Deleted volume successfully. Sep 28 17:15:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-db94ddb1-c026-46b7-a9e1-4d3a75bc777e tempest-AttachVolumeNegativeTest-2033009855 None] Lock "cinder-5c82f103-dae4-42be-9cdc-13ee6a29f48d-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Flow 'volume_create_manager' (1f8a420e-ef48-4342-9ebb-173a0a4675b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc21de-c45f-4ca8-a558-df4d2cb3d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc21de-c45f-4ca8-a558-df4d2cb3d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-422268556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710e1d46-7277-4278-8fbd-9fb121194251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373358afd03b4c3eb1d31d13b5a73ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:32Z,use_quota=True,user_id='0f3191a4d5e44983a5fc73dd4f5075ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bd6faf-502e-4134-8f75-8c189b54c6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bd6faf-502e-4134-8f75-8c189b54c6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5415e8-9019-4505-a988-540784250304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5415e8-9019-4505-a988-540784250304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710e1d46-7277-4278-8fbd-9fb121194251', 'volume_name': 'volume-710e1d46-7277-4278-8fbd-9fb121194251', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f284bc53-e932-4d94-96b7-3a1d8fa582ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f284bc53-e932-4d94-96b7-3a1d8fa582ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75116374-5fbf-4035-ba36-f91dbbe9ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Volume 710e1d46-7277-4278-8fbd-9fb121194251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710e1d46-7277-4278-8fbd-9fb121194251', 'volume_size': 1} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-422268556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710e1d46-7277-4278-8fbd-9fb121194251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373358afd03b4c3eb1d31d13b5a73ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:32Z,use_quota=True,user_id='0f3191a4d5e44983a5fc73dd4f5075ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Creating volume 710e1d46-7277-4278-8fbd-9fb121194251 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:32 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:15:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:32 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 1073741824 Sep 28 17:15:32 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:33 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 1073741824" returned: 0 in 1.152s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:33 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 Sep 28 17:15:33 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:33 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251" returned: 0 in 0.695s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75116374-5fbf-4035-ba36-f91dbbe9ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710e1d46-7277-4278-8fbd-9fb121194251', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fbb2c-e45f-4c82-973a-dbdd0021a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Volume volume-710e1d46-7277-4278-8fbd-9fb121194251 (710e1d46-7277-4278-8fbd-9fb121194251): created successfully Sep 28 17:15:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fbb2c-e45f-4c82-973a-dbdd0021a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Flow 'volume_create_manager' (1f8a420e-ef48-4342-9ebb-173a0a4675b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bc438b34-dc76-4b2f-b316-e4708914d43c tempest-TestMinimumBasicScenario-976441269 None] Created volume successfully. Sep 28 17:15:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-73c5edc9-24a3-4a4f-a807-0e376e341460 req-f7b58bdc-ade4-4745-80b8-2a31df549e3d tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-73c5edc9-24a3-4a4f-a807-0e376e341460 req-f7b58bdc-ade4-4745-80b8-2a31df549e3d tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-73c5edc9-24a3-4a4f-a807-0e376e341460 req-f7b58bdc-ade4-4745-80b8-2a31df549e3d tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-73c5edc9-24a3-4a4f-a807-0e376e341460 req-f7b58bdc-ade4-4745-80b8-2a31df549e3d tempest-TestMinimumBasicScenario-976441269 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-710e1d46-7277-4278-8fbd-9fb121194251', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472dc466-1e03-4424-9377-508aeb73fac2', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:15:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-73c5edc9-24a3-4a4f-a807-0e376e341460 req-f7b58bdc-ade4-4745-80b8-2a31df549e3d tempest-TestMinimumBasicScenario-976441269 None] attachment_update completed successfully. Sep 28 17:15:46 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:46 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:47 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (e236b4cb-4064-4f54-8af1-7b5eabb47029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09a881f-247f-42dd-a216-36b40c91edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09a881f-247f-42dd-a216-36b40c91edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2029577730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a908d-5803-45c6-8f20-306f691cbeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:48Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(824babfd-ee51-4729-a7b8-9e164da4db10),volume_type_id=824babfd-ee51-4729-a7b8-9e164da4db10)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e28c2b7-a630-4ea6-8a95-a573b84ef747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e28c2b7-a630-4ea6-8a95-a573b84ef747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c03617-b25f-4476-9bf7-4b0fd0b411af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c03617-b25f-4476-9bf7-4b0fd0b411af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15a908d-5803-45c6-8f20-306f691cbeac', 'volume_name': 'volume-c15a908d-5803-45c6-8f20-306f691cbeac', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dfc6dd-524f-49f0-9545-db06968e46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dfc6dd-524f-49f0-9545-db06968e46b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cac3c5-df3a-4312-8a03-66a43f6843bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume c15a908d-5803-45c6-8f20-306f691cbeac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15a908d-5803-45c6-8f20-306f691cbeac', 'volume_size': 1} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2029577730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a908d-5803-45c6-8f20-306f691cbeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:48Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(824babfd-ee51-4729-a7b8-9e164da4db10),volume_type_id=824babfd-ee51-4729-a7b8-9e164da4db10)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Creating volume c15a908d-5803-45c6-8f20-306f691cbeac {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:48 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:15:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:48 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac 1073741824 Sep 28 17:15:48 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:49 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac 1073741824" returned: 0 in 1.119s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (bb677a8d-c2d0-42fa-83f7-bd0c98e245c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dfbd78-e781-4b78-bbad-5ac93799d1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dfbd78-e781-4b78-bbad-5ac93799d1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-420910325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f5664f-5afb-4195-b0cf-563bca8b350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:49Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6628ac-f73d-4223-ad33-13ca89329ad1),volume_type_id=db6628ac-f73d-4223-ad33-13ca89329ad1)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac Sep 28 17:15:49 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a4e426-46f7-45f9-a9d5-3127a2bd5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a4e426-46f7-45f9-a9d5-3127a2bd5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81dffe-c719-44a5-ba85-c7e895e46c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81dffe-c719-44a5-ba85-c7e895e46c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f5664f-5afb-4195-b0cf-563bca8b350d', 'volume_name': 'volume-49f5664f-5afb-4195-b0cf-563bca8b350d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673455f1-45f3-491a-a39b-700cd73adf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673455f1-45f3-491a-a39b-700cd73adf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8af34-4c41-4b79-897d-c3cb8bf0552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume 49f5664f-5afb-4195-b0cf-563bca8b350d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f5664f-5afb-4195-b0cf-563bca8b350d', 'volume_size': 1} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac" returned: 0 in 0.646s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-420910325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f5664f-5afb-4195-b0cf-563bca8b350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:49Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db6628ac-f73d-4223-ad33-13ca89329ad1),volume_type_id=db6628ac-f73d-4223-ad33-13ca89329ad1)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Creating volume 49f5664f-5afb-4195-b0cf-563bca8b350d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d 1073741824 Sep 28 17:15:50 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cac3c5-df3a-4312-8a03-66a43f6843bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15a908d-5803-45c6-8f20-306f691cbeac', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7174e0ed-d8cc-485f-9621-9a04383d70ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume volume-c15a908d-5803-45c6-8f20-306f691cbeac (c15a908d-5803-45c6-8f20-306f691cbeac): created successfully Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7174e0ed-d8cc-485f-9621-9a04383d70ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (e236b4cb-4064-4f54-8af1-7b5eabb47029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8f7c8377-9f76-48bd-ba5f-1a3c972237bf tempest-GroupSnapshotsV319Test-1575549450 None] Group tempest-GroupSnapshotsV319Test-Group-802892063: creating Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-52d93dfc-70de-48c7-b3f4-b94e113efe60 tempest-TestInstancesWithCinderVolumes-1576522316 None] Created volume successfully. Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8f7c8377-9f76-48bd-ba5f-1a3c972237bf tempest-GroupSnapshotsV319Test-1575549450 None] Group tempest-GroupSnapshotsV319Test-Group-802892063: created successfully Sep 28 17:15:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8f7c8377-9f76-48bd-ba5f-1a3c972237bf tempest-GroupSnapshotsV319Test-1575549450 None] Create group completed successfully. Sep 28 17:15:50 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d 1073741824" returned: 0 in 0.737s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d Sep 28 17:15:50 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (a4036383-6f23-4cab-bc99-03660975426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92eb719-a779-445e-b32e-69ee3d3b5b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92eb719-a779-445e-b32e-69ee3d3b5b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-840596645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43290d6-e5e1-4bf1-9761-ee5e5707784e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:51Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9be216e-311b-4bb8-b37c-9e78cb9d1b63),volume_type_id=c9be216e-311b-4bb8-b37c-9e78cb9d1b63)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c9b7a-9fc1-4a16-913f-77443bf101fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c9b7a-9fc1-4a16-913f-77443bf101fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb27e02-f9e8-4d81-a53c-5456a3b25449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:15:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-05e73bde-dbdf-4b52-9ffd-ecb9c91d8cd9 tempest-TestShelveInstance-1452814021 None] Terminate volume connection completed successfully. Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-05e73bde-dbdf-4b52-9ffd-ecb9c91d8cd9 tempest-TestShelveInstance-1452814021 None] Deleting attachment fe0d99e7-83a4-4792-9b9e-e2ee835ff0d6. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:15:51 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d" returned: 0 in 0.622s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8af34-4c41-4b79-897d-c3cb8bf0552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f5664f-5afb-4195-b0cf-563bca8b350d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5020b15-0779-4837-a186-44bafa3b9c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Acquiring lock "cinder-68082509-ca33-4819-b0ce-1a3cd4efdfe4-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume volume-49f5664f-5afb-4195-b0cf-563bca8b350d (49f5664f-5afb-4195-b0cf-563bca8b350d): created successfully Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5020b15-0779-4837-a186-44bafa3b9c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (bb677a8d-c2d0-42fa-83f7-bd0c98e245c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "cinder-68082509-ca33-4819-b0ce-1a3cd4efdfe4-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-95fbf7c0-dfe9-490c-acaa-341441d20bb1 tempest-TestInstancesWithCinderVolumes-1576522316 None] Created volume successfully. Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Acquiring lock "cinder-quobyte-68082509-ca33-4819-b0ce-1a3cd4efdfe4" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "cinder-quobyte-68082509-ca33-4819-b0ce-1a3cd4efdfe4" acquired by "delete_volume" :: waited 0.060s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1b786-7dad-4a2b-9378-7b2937a2b180]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb27e02-f9e8-4d81-a53c-5456a3b25449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c43290d6-e5e1-4bf1-9761-ee5e5707784e', 'volume_name': 'volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e', 'volume_size': 1, 'image_id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1341205019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2004d20564944c6d8007abe3e2c8b0e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a613b9ed-fda6-45c4-8bb9-e76eda759682/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1555416-ecd9-4c58-acdb-8dbdd0a4b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1555416-ecd9-4c58-acdb-8dbdd0a4b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c368a5-cc04-4fb1-be4b-e1ebc1c3630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume c43290d6-e5e1-4bf1-9761-ee5e5707784e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e', 'volume_size': 1, 'image_id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1341205019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2004d20564944c6d8007abe3e2c8b0e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a613b9ed-fda6-45c4-8bb9-e76eda759682/file', 'properties': {}}, 'image_service': } Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Trying to clone c43290d6-e5e1-4bf1-9761-ee5e5707784e from image a613b9ed-fda6-45c4-8bb9-e76eda759682 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:15:52 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 Sep 28 17:15:52 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Flow 'volume_create_manager' (dfb3a555-c4a3-4eac-837d-3f3e5ffb9a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5145c069-6722-41df-b1d8-782b2eeccc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5145c069-6722-41df-b1d8-782b2eeccc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088841011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1c5a5e-210a-47cc-a90b-2c981bd51eb0,host='devstack@QuobyteHD#QuobyteHD',id=8a14db05-c6b0-4728-9d8d-878b78610afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2d7e1cc0dd4f739a07764b1b471669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:53Z,use_quota=True,user_id='6dd2ce984ae0471fbee77096dc702def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(600bfe6c-4b04-4435-a1b6-c8be4df033a8),volume_type_id=600bfe6c-4b04-4435-a1b6-c8be4df033a8)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b1333-1bb5-4ee4-89d3-b1314df57b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b1333-1bb5-4ee4-89d3-b1314df57b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a6bfe-e161-4cac-a4ac-2dccc8ef46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55a6bfe-e161-4cac-a4ac-2dccc8ef46df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a14db05-c6b0-4728-9d8d-878b78610afa', 'volume_name': 'volume-8a14db05-c6b0-4728-9d8d-878b78610afa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a4fa08-a73d-4cf0-b22b-b09c958e1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a4fa08-a73d-4cf0-b22b-b09c958e1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98965142-3b60-4aeb-a9fa-ea1feec39a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Volume 8a14db05-c6b0-4728-9d8d-878b78610afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a14db05-c6b0-4728-9d8d-878b78610afa', 'volume_size': 1} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df1c5a5e-210a-47cc-a90b-2c981bd51eb0,created_at=2026-09-28T15:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2088841011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df1c5a5e-210a-47cc-a90b-2c981bd51eb0,host='devstack@QuobyteHD#QuobyteHD',id=8a14db05-c6b0-4728-9d8d-878b78610afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb2d7e1cc0dd4f739a07764b1b471669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:53Z,use_quota=True,user_id='6dd2ce984ae0471fbee77096dc702def',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(600bfe6c-4b04-4435-a1b6-c8be4df033a8),volume_type_id=600bfe6c-4b04-4435-a1b6-c8be4df033a8)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Creating volume 8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:52 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:15:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa 1073741824 Sep 28 17:15:53 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4" returned: 0 in 1.051s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4 Sep 28 17:15:53 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-68082509-ca33-4819-b0ce-1a3cd4efdfe4" returned: 0 in 0.313s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "cinder-quobyte-68082509-ca33-4819-b0ce-1a3cd4efdfe4" released by "delete_volume" :: held 1.469s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG cinder.quota [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Created reservations ['cbc37d9b-b471-454d-b00e-c09b6684d406', '04d8fdf5-21b6-4825-87b3-23d928501955', '555069aa-b591-47f8-9e41-da3d1f819550', '0cdec49d-8730-4a6f-9f65-af5ffc338f51'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa 1073741824" returned: 0 in 0.697s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:15:53 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa Sep 28 17:15:53 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:54 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.550s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.manager [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Deleted volume successfully. Sep 28 17:15:54 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa" returned: 0 in 0.513s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98965142-3b60-4aeb-a9fa-ea1feec39a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a14db05-c6b0-4728-9d8d-878b78610afa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e1170a-e3dd-4023-bd40-ff085d27d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [req-80f889e8-4413-4ab3-88c1-111cffff3633 req-dae206d0-2995-43f0-9097-b70e954d1978 tempest-TestShelveInstance-1452814021 None] Lock "cinder-68082509-ca33-4819-b0ce-1a3cd4efdfe4-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Volume volume-8a14db05-c6b0-4728-9d8d-878b78610afa (8a14db05-c6b0-4728-9d8d-878b78610afa): created successfully Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e1170a-e3dd-4023-bd40-ff085d27d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Flow 'volume_create_manager' (dfb3a555-c4a3-4eac-837d-3f3e5ffb9a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c7a33679-2442-4cb7-832a-98435f447763 tempest-GroupSnapshotsV319Test-1575549450 None] Created volume successfully. Sep 28 17:15:56 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] GroupSnapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: creating. Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Group snapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: creating. {{(pid=87034) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Creating offline snapshot c3c5bc21-69a1-4623-84a6-2fc900803b9a of volume 8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ca420d-7543-4589-83c9-a01da1712887]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa Sep 28 17:15:56 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa" returned: 0 in 0.623s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a 1G Sep 28 17:15:56 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a 1G" returned: 0 in 0.561s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a14db05-c6b0-4728-9d8d-878b78610afa -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:57 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a14db05-c6b0-4728-9d8d-878b78610afa -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a Sep 28 17:15:57 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a14db05-c6b0-4728-9d8d-878b78610afa -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a" returned: 0 in 0.387s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:15:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:57 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a Sep 28 17:15:57 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD, size 20.69 MB, duration 5.86 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:15:58 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Image download 20.69 MB at 3.53 MB/s Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a" returned: 0 in 0.425s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[330fbc64-8524-4a78-970e-c09835ed79d2]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info Sep 28 17:15:58 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD Sep 28 17:15:58 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info" returned: 0 in 0.438s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:58 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Temporary image a613b9ed-fda6-45c4-8bb9-e76eda759682 is fetched for user 41b79b7f08994b25b5e72d11c393db70. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:15:58 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info Sep 28 17:15:58 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c734d-8b71-4a12-bdf3-a95d6b98b71a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.info" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:58 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD Sep 28 17:15:58 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5ba856f6-fd9b-4cef-b97f-1138b838b76a tempest-GroupSnapshotsV319Test-1575549450 None] group_snapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: created successfully Sep 28 17:15:59 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-840596645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43290d6-e5e1-4bf1-9761-ee5e5707784e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2004d20564944c6d8007abe3e2c8b0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:51Z,use_quota=True,user_id='41b79b7f08994b25b5e72d11c393db70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9be216e-311b-4bb8-b37c-9e78cb9d1b63),volume_type_id=c9be216e-311b-4bb8-b37c-9e78cb9d1b63)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Creating volume c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:15:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1073741824 Sep 28 17:15:59 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] group_snapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: deleting Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] group_snapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: deleting {{(pid=87034) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:16:00 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1073741824" returned: 0 in 0.850s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "cinder-quobyte-c3c5bc21-69a1-4623-84a6-2fc900803b9a" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-c3c5bc21-69a1-4623-84a6-2fc900803b9a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Deleting offline snapshot c3c5bc21-69a1-4623-84a6-2fc900803b9a of volume 8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] snapshot_file for this snap is: volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e Sep 28 17:16:00 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[605cec9c-0bd4-4cbb-931c-9c38f6fc831c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a Sep 28 17:16:00 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e" returned: 0 in 0.435s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Attempting download of a613b9ed-fda6-45c4-8bb9-e76eda759682 ((None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}])) to volume c43290d6-e5e1-4bf1-9761-ee5e5707784e. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b3d693-44ee-469e-8d07-50c8b4e1c3a8]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a" returned: 0 in 0.690s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a14db05-c6b0-4728-9d8d-878b78610afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:01 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602 Sep 28 17:16:01 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b92f0d-7080-4237-a73c-a05c40d15223]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602" returned: 0 in 0.537s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa Sep 28 17:16:01 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602 Sep 28 17:16:01 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa" returned: 0 in 0.964s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602" returned: 1 in 0.653s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a613b9ed-fda6-45c4-8bb9-e76eda759682_vjx2s602' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc71e7e-707a-42f1-8a9b-d07b2aee9df1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a Sep 28 17:16:02 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD Sep 28 17:16:02 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:02 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] a613b9ed-fda6-45c4-8bb9-e76eda759682 was qcow2, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:16:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e Sep 28 17:16:02 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:03 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a" returned: 0 in 1.019s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:03 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a Sep 28 17:16:03 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:03 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.674s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:03 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa.c3c5bc21-69a1-4623-84a6-2fc900803b9a" returned: 0 in 0.692s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-c3c5bc21-69a1-4623-84a6-2fc900803b9a" released by "_delete_snapshot" :: held 3.625s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" released by "delete_snapshot" :: held 3.661s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:04 devstack cinder-volume[87034]: WARNING cinder.quota [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2098414426 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2098414426, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:04 devstack cinder-volume[87034]: WARNING cinder.quota [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2098414426 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2098414426, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:04 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] Created reservations ['2d4cf7b7-8b35-422b-97df-5c5025f9c167', 'd514f3ac-de53-43ed-baf6-755a1c634f15', '75eff3d6-7c50-474d-8281-09b4205de6e1', 'bc135961-96d3-496a-942e-601fbc54d2b4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-693f1c08-bb9e-4891-b340-b6a5ed505b9e tempest-GroupSnapshotsV319Test-1575549450 None] group_snapshot 3bba35ab-25b1-4b9a-987b-d6218d30f074: deleted successfully Sep 28 17:16:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[155551a1-a676-4aa4-a2e0-95e503a1ed37]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:05 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa Sep 28 17:16:05 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:06 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa" returned: 0 in 0.651s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:06 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa Sep 28 17:16:06 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:06 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a14db05-c6b0-4728-9d8d-878b78610afa" returned: 0 in 0.450s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:06 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e" returned: 0 in 3.763s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a613b9ed-fda6-45c4-8bb9-e76eda759682_ait_byoidevstack@QuobyteHD, size 112.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:06 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Converted 112.00 MB image at 29.75 MB/s Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "cinder-quobyte-8a14db05-c6b0-4728-9d8d-878b78610afa" released by "delete_volume" :: held 1.262s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:06 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1G Sep 28 17:16:06 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Created reservations ['e5f81f15-85e4-42b2-8f3d-f8d6e930cda4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:06 devstack cinder-volume[87034]: WARNING cinder.quota [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2098414426 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2098414426, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Created reservations ['b424467e-261a-4bf5-8b2d-b38bcdc41351', 'f6b29525-9000-41ac-ace4-3d4910365c8a', '76310832-aa38-4eac-af5b-c29fdc63cadd', '631b36f5-fede-4375-9498-c8ad57889118'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:07 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:07 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:07 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e 1G" returned: 0 in 0.610s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Downloaded image a613b9ed-fda6-45c4-8bb9-e76eda759682 ((None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}])) to volume c43290d6-e5e1-4bf1-9761-ee5e5707784e successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Temporary image a613b9ed-fda6-45c4-8bb9-e76eda759682 for user 41b79b7f08994b25b5e72d11c393db70 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Marking volume c43290d6-e5e1-4bf1-9761-ee5e5707784e as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Copying metadata from image a613b9ed-fda6-45c4-8bb9-e76eda759682 to c43290d6-e5e1-4bf1-9761-ee5e5707784e. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Creating volume glance metadata for volume c43290d6-e5e1-4bf1-9761-ee5e5707784e backed by image a613b9ed-fda6-45c4-8bb9-e76eda759682 with: {'image_id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'image_name': 'tempest-scenario-img--1341205019', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c368a5-cc04-4fb1-be4b-e1ebc1c3630e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e', 'volume_size': 1, 'image_id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a613b9ed-fda6-45c4-8bb9-e76eda759682', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1341205019', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2004d20564944c6d8007abe3e2c8b0e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a613b9ed-fda6-45c4-8bb9-e76eda759682', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a613b9ed-fda6-45c4-8bb9-e76eda759682/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5b1d8-1af2-490d-8f8d-88ae0877897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:07 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Volume volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e (c43290d6-e5e1-4bf1-9761-ee5e5707784e): created successfully Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf5b1d8-1af2-490d-8f8d-88ae0877897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Flow 'volume_create_manager' (a4036383-6f23-4cab-bc99-03660975426c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-66f94244-4e18-4b75-afbb-39f0e3608094 tempest-TestInstancesWithCinderVolumes-1576522316 None] Created volume successfully. Sep 28 17:16:07 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-547a8fb5-7367-4e80-971b-945590872632 tempest-GroupSnapshotsV319Test-1575549450 None] Delete group completed successfully. Sep 28 17:16:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1b556d9d-f46e-4ffe-8d0e-026547e84241 req-d2ce1392-e66a-4473-9659-2516c948863b tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1b556d9d-f46e-4ffe-8d0e-026547e84241 req-d2ce1392-e66a-4473-9659-2516c948863b tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1b556d9d-f46e-4ffe-8d0e-026547e84241 req-d2ce1392-e66a-4473-9659-2516c948863b tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-1b556d9d-f46e-4ffe-8d0e-026547e84241 req-d2ce1392-e66a-4473-9659-2516c948863b tempest-TestInstancesWithCinderVolumes-1576522316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b84a3845-9b58-47ab-ba67-8762ea872983', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-1b556d9d-f46e-4ffe-8d0e-026547e84241 req-d2ce1392-e66a-4473-9659-2516c948863b tempest-TestInstancesWithCinderVolumes-1576522316 None] attachment_update completed successfully. Sep 28 17:16:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b07e0609-d121-4ae3-b2c0-4944546b5998 tempest-GroupsTest-2048005760 None] Group tempest-Group1-221675094: creating Sep 28 17:16:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b07e0609-d121-4ae3-b2c0-4944546b5998 tempest-GroupsTest-2048005760 None] Group tempest-Group1-221675094: created successfully Sep 28 17:16:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b07e0609-d121-4ae3-b2c0-4944546b5998 tempest-GroupsTest-2048005760 None] Create group completed successfully. Sep 28 17:16:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0bbe02d8-9ae4-4796-8547-6cf230c678a2 tempest-GroupsTest-2048005760 None] Group tempest-Group2-129219917: creating Sep 28 17:16:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0bbe02d8-9ae4-4796-8547-6cf230c678a2 tempest-GroupsTest-2048005760 None] Group tempest-Group2-129219917: created successfully Sep 28 17:16:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0bbe02d8-9ae4-4796-8547-6cf230c678a2 tempest-GroupsTest-2048005760 None] Create group completed successfully. Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Flow 'volume_create_manager' (4b9274d5-7247-45ed-bcab-1922ffe14e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cba40b-87ec-4556-8ea5-8b8f6849f736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cba40b-87ec-4556-8ea5-8b8f6849f736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f36af9c-b8df-44fc-aaba-ba2821bad30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f38e8e3b48a883f15f6f99643759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:25Z,use_quota=True,user_id='f66646ae1e644554bf53e9382f9fc183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e168a297-870a-4693-986c-3760762d05b4),volume_type_id=e168a297-870a-4693-986c-3760762d05b4)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f27135-9bdb-4699-8da7-5b47a391b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f27135-9bdb-4699-8da7-5b47a391b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb7ff2-365a-4e8e-953c-f0ea9bfb7df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb7ff2-365a-4e8e-953c-f0ea9bfb7df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f36af9c-b8df-44fc-aaba-ba2821bad30f', 'volume_name': 'volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f', 'volume_size': 1, 'image_id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde531b50d8b1bcea746e7be0da75e58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad9f38e8e3b48a883f15f6f99643759', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e7d20c2f567d1a54cc528bcb3607520889a2edb9e154e7a7ea13b744b50997d72418f45cc006e1ca757597d0582275b69d7dee42bccda32aa5d4d723939e7aa', 'id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'created_at': datetime.datetime(2026, 9, 28, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa38c69d-5f82-4515-8e20-16909db645ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa52ad8-a8ee-4d90-8002-4d78995adbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa52ad8-a8ee-4d90-8002-4d78995adbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f10fc8-bba5-4b1f-9e06-fb0ca7aa66e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f', 'volume_size': 1, 'image_id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde531b50d8b1bcea746e7be0da75e58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad9f38e8e3b48a883f15f6f99643759', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e7d20c2f567d1a54cc528bcb3607520889a2edb9e154e7a7ea13b744b50997d72418f45cc006e1ca757597d0582275b69d7dee42bccda32aa5d4d723939e7aa', 'id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'created_at': datetime.datetime(2026, 9, 28, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa38c69d-5f82-4515-8e20-16909db645ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Trying to clone 9f36af9c-b8df-44fc-aaba-ba2821bad30f from image aa38c69d-5f82-4515-8e20-16909db645ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:16:26 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (7c949270-e64c-4014-840d-0e55006c6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4595ff-a7d3-4a3e-93e0-f927d889e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4595ff-a7d3-4a3e-93e0-f927d889e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154238531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57e7d193-4cbe-4731-987e-fce25606a1b5,host='devstack@QuobyteHD#QuobyteHD',id=612ed0d9-5179-4e2a-bf9b-ff792774331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:26Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38075b1-1f99-4be2-925c-4f8ef0ed5b82),volume_type_id=a38075b1-1f99-4be2-925c-4f8ef0ed5b82)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4ae04-0e45-4023-9faa-8e016a6d596c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4ae04-0e45-4023-9faa-8e016a6d596c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7545b170-c5f8-4c48-8893-4b8ddd1b2343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7545b170-c5f8-4c48-8893-4b8ddd1b2343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612ed0d9-5179-4e2a-bf9b-ff792774331b', 'volume_name': 'volume-612ed0d9-5179-4e2a-bf9b-ff792774331b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f153f716-52ad-4d81-a6c6-800a6e1ce775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f153f716-52ad-4d81-a6c6-800a6e1ce775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4fa372-7f99-4b18-999a-58fe5de7022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Volume 612ed0d9-5179-4e2a-bf9b-ff792774331b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612ed0d9-5179-4e2a-bf9b-ff792774331b', 'volume_size': 1} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57e7d193-4cbe-4731-987e-fce25606a1b5,created_at=2026-09-28T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154238531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57e7d193-4cbe-4731-987e-fce25606a1b5,host='devstack@QuobyteHD#QuobyteHD',id=612ed0d9-5179-4e2a-bf9b-ff792774331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:26Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38075b1-1f99-4be2-925c-4f8ef0ed5b82),volume_type_id=a38075b1-1f99-4be2-925c-4f8ef0ed5b82)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Creating volume 612ed0d9-5179-4e2a-bf9b-ff792774331b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:26 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[848fce14-b29a-4146-a2b2-addd298badc4]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b 1073741824 Sep 28 17:16:26 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:27 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 0 in 0.636s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:27 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:27 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b 1073741824" returned: 0 in 1.091s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:28 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b Sep 28 17:16:28 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:28 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 1 in 0.790s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Temporary image aa38c69d-5f82-4515-8e20-16909db645ea is fetched for user f66646ae1e644554bf53e9382f9fc183. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5faac5d-abf6-48e6-96b6-c3c423ec7735]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:28 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:28 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:28 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b" returned: 0 in 0.726s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d4fa372-7f99-4b18-999a-58fe5de7022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612ed0d9-5179-4e2a-bf9b-ff792774331b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160e3cc-3d1f-4fe9-848b-8ffbf3610a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Volume volume-612ed0d9-5179-4e2a-bf9b-ff792774331b (612ed0d9-5179-4e2a-bf9b-ff792774331b): created successfully Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8160e3cc-3d1f-4fe9-848b-8ffbf3610a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (7c949270-e64c-4014-840d-0e55006c6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0b04be97-b3ae-4990-bb5b-e7da9b45271e tempest-GroupsTest-2048005760 None] Created volume successfully. Sep 28 17:16:29 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:29 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:29 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:29 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 1 in 0.695s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f36af9c-b8df-44fc-aaba-ba2821bad30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f38e8e3b48a883f15f6f99643759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:25Z,use_quota=True,user_id='f66646ae1e644554bf53e9382f9fc183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e168a297-870a-4693-986c-3760762d05b4),volume_type_id=e168a297-870a-4693-986c-3760762d05b4)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Creating volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:29 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1073741824 Sep 28 17:16:30 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1073741824" returned: 0 in 1.205s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Acquiring lock "cinder-quobyte-612ed0d9-5179-4e2a-bf9b-ff792774331b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-612ed0d9-5179-4e2a-bf9b-ff792774331b" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf72bf0-4068-4e7a-8eff-e26a0ce19036]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:31 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f Sep 28 17:16:31 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b Sep 28 17:16:31 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f" returned: 0 in 0.608s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:31 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Attempting download of aa38c69d-5f82-4515-8e20-16909db645ea ((None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}])) to volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:16:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155ffa4-9979-4f4d-8f94-4072ab737bf9]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:32 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b" returned: 0 in 0.801s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:32 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b Sep 28 17:16:32 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:32 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv Sep 28 17:16:32 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-612ed0d9-5179-4e2a-bf9b-ff792774331b" returned: 0 in 0.873s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-612ed0d9-5179-4e2a-bf9b-ff792774331b" released by "delete_volume" :: held 1.812s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:33 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv" returned: 0 in 1.149s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Created reservations ['8c3d43ad-2a37-4554-846c-1cc042e6e66f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:33 devstack cinder-volume[87034]: WARNING cinder.quota [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1497122220 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1497122220, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:33 devstack cinder-volume[87034]: WARNING cinder.quota [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1497122220 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1497122220, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Created reservations ['c03d53e1-77fb-4f89-b01a-dc35698bf573', '5b150775-fd56-40f1-b837-da214c78071e', '1081b60d-1583-4c15-9a22-8bcb336b2ee7', 'bae24282-85d2-4298-90c8-19f7ef89c4ad'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:33 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv Sep 28 17:16:33 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:33 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:34 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv" returned: 1 in 1.040s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa38c69d-5f82-4515-8e20-16909db645ea_x4oxmquv' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c39b9-3843-4af2-87fa-50f82a2dd0c7]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:34 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:34 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:34 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.910s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f3ccc86b-34d6-41f0-ba9f-f645db7df268 tempest-GroupsTest-2048005760 None] Delete group completed successfully. Sep 28 17:16:34 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Created reservations ['bb710669-bad7-4ddc-ac68-aacf28fcf4b3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:35 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 0 in 0.879s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:35 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:35 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD Sep 28 17:16:35 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-57029745-57ee-4949-8365-eca52b0a853a req-418c369d-dc17-4e4d-a7ab-cd7f490ffacc tempest-TestMinimumBasicScenario-976441269 None] Terminate volume connection completed successfully. Sep 28 17:16:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-57029745-57ee-4949-8365-eca52b0a853a req-418c369d-dc17-4e4d-a7ab-cd7f490ffacc tempest-TestMinimumBasicScenario-976441269 None] Deleting attachment 472dc466-1e03-4424-9377-508aeb73fac2. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:16:36 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.870s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-43fc5977-348b-4260-a93b-3176d1e60d04 tempest-GroupsTest-2048005760 None] Delete group completed successfully. Sep 28 17:16:36 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD" returned: 1 in 1.073s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] aa38c69d-5f82-4515-8e20-16909db645ea was raw, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f Sep 28 17:16:36 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "cinder-710e1d46-7277-4278-8fbd-9fb121194251-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "cinder-710e1d46-7277-4278-8fbd-9fb121194251-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "cinder-quobyte-710e1d46-7277-4278-8fbd-9fb121194251" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "cinder-quobyte-710e1d46-7277-4278-8fbd-9fb121194251" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[411b0bde-69c0-430e-8286-9379469d5cfa]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 Sep 28 17:16:37 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f" returned: 0 in 1.034s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa38c69d-5f82-4515-8e20-16909db645ea__3mki1w1devstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:37 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1G Sep 28 17:16:37 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6e4e103a-a74f-40c4-8e26-18818e1561f9 tempest-GroupsTest-2048005760 None] Group tempest-GroupsTest-Group-1098870891: creating Sep 28 17:16:37 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6e4e103a-a74f-40c4-8e26-18818e1561f9 tempest-GroupsTest-2048005760 None] Group tempest-GroupsTest-Group-1098870891: created successfully Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251" returned: 0 in 0.636s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6e4e103a-a74f-40c4-8e26-18818e1561f9 tempest-GroupsTest-2048005760 None] Create group completed successfully. Sep 28 17:16:37 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251 Sep 28 17:16:37 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:38 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f 1G" returned: 0 in 0.683s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Downloaded image aa38c69d-5f82-4515-8e20-16909db645ea ((None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}])) to volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Temporary image aa38c69d-5f82-4515-8e20-16909db645ea for user f66646ae1e644554bf53e9382f9fc183 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Marking volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:16:38 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-710e1d46-7277-4278-8fbd-9fb121194251" returned: 0 in 0.423s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "cinder-quobyte-710e1d46-7277-4278-8fbd-9fb121194251" released by "delete_volume" :: held 1.138s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Copying metadata from image aa38c69d-5f82-4515-8e20-16909db645ea to 9f36af9c-b8df-44fc-aaba-ba2821bad30f. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Creating volume glance metadata for volume 9f36af9c-b8df-44fc-aaba-ba2821bad30f backed by image aa38c69d-5f82-4515-8e20-16909db645ea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cde531b50d8b1bcea746e7be0da75e58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Created reservations ['0a83b8cd-b330-4f46-9cef-8b7cb2bedc63', '527d6447-fecc-4eed-bbe0-a64a8001634b', '04d64ec5-0d30-46c4-a158-d6c6bc9f4ecc', '9b4c951d-630f-4aca-abb9-0511eb19cba0'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f10fc8-bba5-4b1f-9e06-fb0ca7aa66e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f', 'volume_size': 1, 'image_id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa38c69d-5f82-4515-8e20-16909db645ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde531b50d8b1bcea746e7be0da75e58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fad9f38e8e3b48a883f15f6f99643759', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e7d20c2f567d1a54cc528bcb3607520889a2edb9e154e7a7ea13b744b50997d72418f45cc006e1ca757597d0582275b69d7dee42bccda32aa5d4d723939e7aa', 'id': 'aa38c69d-5f82-4515-8e20-16909db645ea', 'created_at': datetime.datetime(2026, 9, 28, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa38c69d-5f82-4515-8e20-16909db645ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa60d92-0a1f-4954-8a98-2cdccf366e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Volume volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f (9f36af9c-b8df-44fc-aaba-ba2821bad30f): created successfully Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa60d92-0a1f-4954-8a98-2cdccf366e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Flow 'volume_create_manager' (4b9274d5-7247-45ed-bcab-1922ffe14e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4c62c647-6778-44c5-b668-f38312f5cacc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Created volume successfully. Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:38 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:38 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:39 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.533s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Deleted volume successfully. Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2072b554-e85b-4b03-b6fc-116cfc58ddcf tempest-TestMinimumBasicScenario-976441269 None] Lock "cinder-710e1d46-7277-4278-8fbd-9fb121194251-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Acquiring lock "cinder-9f36af9c-b8df-44fc-aaba-ba2821bad30f-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "cinder-9f36af9c-b8df-44fc-aaba-ba2821bad30f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Acquiring lock "cinder-quobyte-9f36af9c-b8df-44fc-aaba-ba2821bad30f" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "cinder-quobyte-9f36af9c-b8df-44fc-aaba-ba2821bad30f" acquired by "delete_volume" :: waited 0.077s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df5c3d5-0c93-4689-b63d-03d9c86cd519]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f Sep 28 17:16:40 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (1531f4fb-d852-42d6-aefb-eb8f36223cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8523a474-5fe6-40a4-8741-71a200d48966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8523a474-5fe6-40a4-8741-71a200d48966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052256854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,host='devstack@QuobyteHD#QuobyteHD',id=4393af64-d2f5-4a3f-b960-47804450ed67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:40Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(921fa138-1971-4836-8187-67ab713b6db2),volume_type_id=921fa138-1971-4836-8187-67ab713b6db2)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dc4e94-9fcc-4d83-b4b3-40fa6dc9ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dc4e94-9fcc-4d83-b4b3-40fa6dc9ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42bb92-3bcd-41f0-9f28-8438e9f46558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42bb92-3bcd-41f0-9f28-8438e9f46558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4393af64-d2f5-4a3f-b960-47804450ed67', 'volume_name': 'volume-4393af64-d2f5-4a3f-b960-47804450ed67', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8690d497-9dae-4c45-824d-5ebf8503bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8690d497-9dae-4c45-824d-5ebf8503bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf74931-7d53-4cce-9e85-6fcf0d5d0e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:40 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Volume 4393af64-d2f5-4a3f-b960-47804450ed67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4393af64-d2f5-4a3f-b960-47804450ed67', 'volume_size': 1} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,created_at=2026-09-28T15:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052256854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,host='devstack@QuobyteHD#QuobyteHD',id=4393af64-d2f5-4a3f-b960-47804450ed67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:40Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(921fa138-1971-4836-8187-67ab713b6db2),volume_type_id=921fa138-1971-4836-8187-67ab713b6db2)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Creating volume 4393af64-d2f5-4a3f-b960-47804450ed67 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:40 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 1073741824 Sep 28 17:16:40 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f" returned: 0 in 1.263s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f Sep 28 17:16:40 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9f36af9c-b8df-44fc-aaba-ba2821bad30f" returned: 0 in 0.515s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 1073741824" returned: 0 in 1.100s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "cinder-quobyte-9f36af9c-b8df-44fc-aaba-ba2821bad30f" released by "delete_volume" :: held 1.962s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:41 devstack cinder-volume[87034]: WARNING cinder.quota [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:41 devstack cinder-volume[87034]: WARNING cinder.quota [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:41 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 Sep 28 17:16:41 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Created reservations ['3e042de2-a9fd-4456-98d4-ee4b4a03f8a2', '3583b7ef-1393-40db-868a-cbc096c2f411', '2bf19648-3978-4953-82ce-77bdc0230cd4', 'a5996cf9-fcc1-4da5-a8b2-649b05b31db2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:42 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:42 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:42 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67" returned: 0 in 0.895s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf74931-7d53-4cce-9e85-6fcf0d5d0e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4393af64-d2f5-4a3f-b960-47804450ed67', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b8f62f-702b-469b-9634-c6c8c037c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:42 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Volume volume-4393af64-d2f5-4a3f-b960-47804450ed67 (4393af64-d2f5-4a3f-b960-47804450ed67): created successfully Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b8f62f-702b-469b-9634-c6c8c037c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (1531f4fb-d852-42d6-aefb-eb8f36223cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e4c6f9af-dbd6-4768-9f58-a2d54a150525 tempest-GroupsTest-2048005760 None] Created volume successfully. Sep 28 17:16:42 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.772s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Deleted volume successfully. Sep 28 17:16:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-57bc083f-64c7-4f70-8e0c-8b627314a1fc tempest-VolumeAndVolumeTypeFromImageTest-257519603 None] Lock "cinder-9f36af9c-b8df-44fc-aaba-ba2821bad30f-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (ec7cf78f-5fa7-4e97-a015-1ef54c083253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66485ff1-934a-40f8-a619-6d9c5875f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66485ff1-934a-40f8-a619-6d9c5875f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940126852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,host='devstack@QuobyteHD#QuobyteHD',id=990a1127-381a-427d-b8fb-42b7e6df5fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(921fa138-1971-4836-8187-67ab713b6db2),volume_type_id=921fa138-1971-4836-8187-67ab713b6db2)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6e9932-cb87-49f4-93a1-0cabd8de0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6e9932-cb87-49f4-93a1-0cabd8de0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fb715b-408e-4c46-a18d-1ee14ed56b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5fb715b-408e-4c46-a18d-1ee14ed56b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990a1127-381a-427d-b8fb-42b7e6df5fcb', 'volume_name': 'volume-990a1127-381a-427d-b8fb-42b7e6df5fcb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16793a79-a32f-451c-bcac-366299775629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16793a79-a32f-451c-bcac-366299775629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57252e8a-75d0-44fb-92f3-7a3da5276ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Volume 990a1127-381a-427d-b8fb-42b7e6df5fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990a1127-381a-427d-b8fb-42b7e6df5fcb', 'volume_size': 1} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,created_at=2026-09-28T15:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940126852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d75f41b-9062-4b95-892d-256e8c0eaa75,host='devstack@QuobyteHD#QuobyteHD',id=990a1127-381a-427d-b8fb-42b7e6df5fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77b1d2d891f4c5bb7308e28def5a728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='532c40be87e34b4583ecd6b6f6b1a75f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(921fa138-1971-4836-8187-67ab713b6db2),volume_type_id=921fa138-1971-4836-8187-67ab713b6db2)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Creating volume 990a1127-381a-427d-b8fb-42b7e6df5fcb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:44 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb 1073741824 Sep 28 17:16:44 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb 1073741824" returned: 0 in 0.780s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:45 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb Sep 28 17:16:45 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb" returned: 0 in 0.406s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57252e8a-75d0-44fb-92f3-7a3da5276ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990a1127-381a-427d-b8fb-42b7e6df5fcb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922339b1-12fd-4961-8521-62a0d4474a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Volume volume-990a1127-381a-427d-b8fb-42b7e6df5fcb (990a1127-381a-427d-b8fb-42b7e6df5fcb): created successfully Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922339b1-12fd-4961-8521-62a0d4474a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Flow 'volume_create_manager' (ec7cf78f-5fa7-4e97-a015-1ef54c083253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7fe51254-e05d-4d3a-89ac-e71e683d6e46 tempest-GroupsTest-2048005760 None] Created volume successfully. Sep 28 17:16:47 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=97,cinder:INSERT=30,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:47 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=89,cinder:UPDATE=93,cinder:INSERT=25,cinder:DELETE=4 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2640a019-2c38-4519-8a28-f06d6b48ef43 tempest-GroupsTest-2048005760 None] Update group completed successfully. Sep 28 17:16:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e4793267-b7b6-4010-9669-2526780044d8 tempest-GroupsTest-2048005760 None] Update group completed successfully. Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (22f72197-39bb-4636-8c09-f046bfed55df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c97cbda-38da-442e-8b87-42a7a64ba834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c97cbda-38da-442e-8b87-42a7a64ba834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724891956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291631d8-a8fa-42eb-9928-7e86e859dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:49Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bef341-9a67-4ab8-aff9-45a87adc6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bef341-9a67-4ab8-aff9-45a87adc6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b55ac1-60e5-4b97-88ce-9117578538d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b55ac1-60e5-4b97-88ce-9117578538d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291631d8-a8fa-42eb-9928-7e86e859dfa9', 'volume_name': 'volume-291631d8-a8fa-42eb-9928-7e86e859dfa9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba4dbc4-7481-4a92-abf0-0fdad23e319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba4dbc4-7481-4a92-abf0-0fdad23e319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494d05c9-0c1c-465a-995f-07e209fc9db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume 291631d8-a8fa-42eb-9928-7e86e859dfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291631d8-a8fa-42eb-9928-7e86e859dfa9', 'volume_size': 1} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724891956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291631d8-a8fa-42eb-9928-7e86e859dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:49Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume 291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:49 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 1073741824 Sep 28 17:16:49 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 1073741824" returned: 0 in 0.658s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 Sep 28 17:16:49 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9" returned: 0 in 0.335s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (494d05c9-0c1c-465a-995f-07e209fc9db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291631d8-a8fa-42eb-9928-7e86e859dfa9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81e7cdf-6078-4395-bc81-e08c598bcf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 (291631d8-a8fa-42eb-9928-7e86e859dfa9): created successfully Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81e7cdf-6078-4395-bc81-e08c598bcf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (22f72197-39bb-4636-8c09-f046bfed55df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3e9345a1-653d-45c9-a534-94be2fbe94f4 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Acquiring lock "cinder-quobyte-4393af64-d2f5-4a3f-b960-47804450ed67" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-4393af64-d2f5-4a3f-b960-47804450ed67" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120ff20-f29a-4731-b756-c433107d1532]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 Sep 28 17:16:50 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67" returned: 0 in 0.418s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67 Sep 28 17:16:51 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4393af64-d2f5-4a3f-b960-47804450ed67" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-4393af64-d2f5-4a3f-b960-47804450ed67" released by "delete_volume" :: held 0.751s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Acquiring lock "cinder-quobyte-990a1127-381a-427d-b8fb-42b7e6df5fcb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-990a1127-381a-427d-b8fb-42b7e6df5fcb" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d81042-e560-4a2a-b694-1e0388068487]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb Sep 28 17:16:51 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating offline snapshot 9c98208d-efec-462d-96db-6981d524a9a6 of volume 291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[432422ba-e601-4227-8a05-82e5f53c9a01]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 Sep 28 17:16:51 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb" returned: 0 in 0.545s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb Sep 28 17:16:51 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9" returned: 0 in 0.581s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 1G Sep 28 17:16:52 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-990a1127-381a-427d-b8fb-42b7e6df5fcb" returned: 0 in 0.377s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "cinder-quobyte-990a1127-381a-427d-b8fb-42b7e6df5fcb" released by "delete_volume" :: held 1.009s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Created reservations ['6c694842-0101-4b02-8405-01e7898012ca'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:52 devstack cinder-volume[87034]: WARNING cinder.quota [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2071436017 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2071436017, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:52 devstack cinder-volume[87034]: WARNING cinder.quota [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2071436017 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2071436017, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Created reservations ['2f71ede4-bec6-4b22-a20a-30fb4ed4d6cf', 'c67c9b44-ca1d-4e06-a941-a24bf6726fdc', 'bd4b9f2f-7d94-4ff7-826f-137371045a6b', 'c1ff34a5-0e70-4170-a284-66014de1ff52'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Created reservations ['20504eb6-3151-4b00-996b-5d5bf6566760', '2937c1b3-fd14-4207-85a0-3b2cba330fb3', '8e05035a-cb5f-4a55-9557-cfc0792f369e', 'a388ef77-d881-42f9-9a64-2a753bf7662c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:16:52 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 1G" returned: 0 in 0.740s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 Sep 28 17:16:52 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.436s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b308cfd1-a858-4d76-bf94-fc922187238d tempest-GroupsTest-2048005760 None] Delete group completed successfully. Sep 28 17:16:53 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6" returned: 0 in 0.464s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 is being set with open permissions: ugo+rw Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:53 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 Sep 28 17:16:53 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6" returned: 0 in 0.355s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:53 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info Sep 28 17:16:53 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:54 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info" returned: 0 in 0.413s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:54 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info is being set with open permissions: ugo+rw Sep 28 17:16:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:54 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info Sep 28 17:16:54 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:54 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.info" returned: 0 in 0.344s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cabaa91b-2745-4e51-9d63-911663a25129 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Create snapshot completed successfully Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (ba474898-dd05-4e78-940f-a02387b53d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e399c-c1ec-44c5-a9aa-ec154246b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e399c-c1ec-44c5-a9aa-ec154246b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367945947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a842bb0-9bcb-472b-8d31-d1d0be820b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:56Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bfa3d0-bd59-4e7d-a88e-aa7b3bc13873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bfa3d0-bd59-4e7d-a88e-aa7b3bc13873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee137b-11cf-4441-ba79-f785f7ae3ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee137b-11cf-4441-ba79-f785f7ae3ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a842bb0-9bcb-472b-8d31-d1d0be820b2a', 'volume_name': 'volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8099ee5d-4639-4c37-be08-8c4db2a388c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8099ee5d-4639-4c37-be08-8c4db2a388c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f0bb96-fea6-4872-824a-dec3be860c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume 8a842bb0-9bcb-472b-8d31-d1d0be820b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a', 'volume_size': 1} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367945947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a842bb0-9bcb-472b-8d31-d1d0be820b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:56Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume 8a842bb0-9bcb-472b-8d31-d1d0be820b2a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:55 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a 1073741824 Sep 28 17:16:56 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (114ccea4-a2eb-4857-83a6-a79d98bcb998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61882d35-219f-4435-a9b1-46b9241e3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61882d35-219f-4435-a9b1-46b9241e3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134491166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a76fda0-b97a-43fc-a25f-05b4120a824e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9df813-6deb-4726-ac72-9f9b85987747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9df813-6deb-4726-ac72-9f9b85987747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe382a6b-5ab8-4b36-94a3-28885a817bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe382a6b-5ab8-4b36-94a3-28885a817bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a76fda0-b97a-43fc-a25f-05b4120a824e', 'volume_name': 'volume-7a76fda0-b97a-43fc-a25f-05b4120a824e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6813b146-c69e-4dcc-b0e7-4d240f36f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6813b146-c69e-4dcc-b0e7-4d240f36f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bffefb-89bd-4e90-b02f-93c622eb060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:56 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume 7a76fda0-b97a-43fc-a25f-05b4120a824e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a76fda0-b97a-43fc-a25f-05b4120a824e', 'volume_size': 1} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:56 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a 1073741824" returned: 0 in 0.863s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a Sep 28 17:16:56 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (6d5f3f3d-c1ae-43e7-acbc-e34eec1ba9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59872657-734b-4662-add2-57c675c171f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59872657-734b-4662-add2-57c675c171f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556306890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53449d82-ed97-4e09-a36b-596e49443e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853b1b8-20d9-4c3a-bd74-f61005183c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7853b1b8-20d9-4c3a-bd74-f61005183c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e98db-51df-4427-b144-0884df52f43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68e98db-51df-4427-b144-0884df52f43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53449d82-ed97-4e09-a36b-596e49443e70', 'volume_name': 'volume-53449d82-ed97-4e09-a36b-596e49443e70', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77def217-7d2b-4fea-ae34-5518c701e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77def217-7d2b-4fea-ae34-5518c701e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee689c2-4da6-4e56-88f7-2d2e4aa6e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume 53449d82-ed97-4e09-a36b-596e49443e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53449d82-ed97-4e09-a36b-596e49443e70', 'volume_size': 1} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:57 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" returned: 0 in 0.584s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-134491166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a76fda0-b97a-43fc-a25f-05b4120a824e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume 7a76fda0-b97a-43fc-a25f-05b4120a824e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:57 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f0bb96-fea6-4872-824a-dec3be860c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e 1073741824 Sep 28 17:16:57 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bc0afa-ccc1-4654-875c-3c0b11ba9c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a (8a842bb0-9bcb-472b-8d31-d1d0be820b2a): created successfully Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bc0afa-ccc1-4654-875c-3c0b11ba9c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (ba474898-dd05-4e78-940f-a02387b53d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-04e5c27b-def1-4a8f-a783-8335d6781c7b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (50cc4db4-9ce9-47a6-a629-646ff23445d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add3f73a-9e90-4ae5-999d-c13a153d92eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add3f73a-9e90-4ae5-999d-c13a153d92eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632118827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2853e67-fbed-42ed-99f4-0adfff380829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:58Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da88852-446b-4e51-bd78-80db0d7137c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da88852-446b-4e51-bd78-80db0d7137c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c255f-a5c3-4b74-84c4-c10163e7bbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c255f-a5c3-4b74-84c4-c10163e7bbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2853e67-fbed-42ed-99f4-0adfff380829', 'volume_name': 'volume-f2853e67-fbed-42ed-99f4-0adfff380829', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bee05-7515-4b85-96a5-0832ca3229c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bee05-7515-4b85-96a5-0832ca3229c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cd3aa8-f271-4410-a123-cb7d3797d23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume f2853e67-fbed-42ed-99f4-0adfff380829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2853e67-fbed-42ed-99f4-0adfff380829', 'volume_size': 1} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:58 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e 1073741824" returned: 0 in 0.941s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (bf1bc523-1713-4a49-b225-561aa89effd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6710f6b-37d8-4dd5-b04c-b537f513932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6710f6b-37d8-4dd5-b04c-b537f513932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805331921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2def94bf-8519-4dad-aa94-75ea5925a502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:58Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa09a0-31d2-4025-b7ce-2ea6e1db9fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa09a0-31d2-4025-b7ce-2ea6e1db9fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fac365f-e0a2-402f-8b48-e58c36ff340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fac365f-e0a2-402f-8b48-e58c36ff340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2def94bf-8519-4dad-aa94-75ea5925a502', 'volume_name': 'volume-2def94bf-8519-4dad-aa94-75ea5925a502', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d22a846-792f-437e-8e55-290ab1a5ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d22a846-792f-437e-8e55-290ab1a5ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c60502-d185-4966-ac45-06cd4bc1ff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume 2def94bf-8519-4dad-aa94-75ea5925a502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2def94bf-8519-4dad-aa94-75ea5925a502', 'volume_size': 1} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:58 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e Sep 28 17:16:58 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:59 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e" returned: 0 in 0.345s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.745s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556306890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53449d82-ed97-4e09-a36b-596e49443e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:57Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume 53449d82-ed97-4e09-a36b-596e49443e70 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:59 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 1073741824 Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bffefb-89bd-4e90-b02f-93c622eb060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a76fda0-b97a-43fc-a25f-05b4120a824e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88483e70-88fe-470c-8eb9-9db94724893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-7a76fda0-b97a-43fc-a25f-05b4120a824e (7a76fda0-b97a-43fc-a25f-05b4120a824e): created successfully Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88483e70-88fe-470c-8eb9-9db94724893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (114ccea4-a2eb-4857-83a6-a79d98bcb998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ac73cc8a-a28c-45ae-a29f-90182068064b tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:16:59 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 1073741824" returned: 0 in 0.680s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:59 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 Sep 28 17:16:59 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70" returned: 0 in 0.438s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.157s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632118827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2853e67-fbed-42ed-99f4-0adfff380829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:58Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume f2853e67-fbed-42ed-99f4-0adfff380829 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:00 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee689c2-4da6-4e56-88f7-2d2e4aa6e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53449d82-ed97-4e09-a36b-596e49443e70', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:00 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 1073741824 Sep 28 17:17:00 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c86762-a7e7-48a5-a653-a1e190db43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-53449d82-ed97-4e09-a36b-596e49443e70 (53449d82-ed97-4e09-a36b-596e49443e70): created successfully Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c86762-a7e7-48a5-a653-a1e190db43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (6d5f3f3d-c1ae-43e7-acbc-e34eec1ba9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7e13472c-c01d-4efa-b839-0c39a23681ab tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:17:01 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 1073741824" returned: 0 in 1.048s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 Sep 28 17:17:01 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-917db3c2-0724-4ab0-a782-08df3cc849f6 req-51f9cce4-2c05-4e91-80ed-c62ea6813d4d tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:01 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805331921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2def94bf-8519-4dad-aa94-75ea5925a502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ee4e193443414982af932d481743c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:58Z,use_quota=True,user_id='0046b3b71bbf437290933ef1f175abaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Creating volume 2def94bf-8519-4dad-aa94-75ea5925a502 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:01 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cd3aa8-f271-4410-a123-cb7d3797d23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2853e67-fbed-42ed-99f4-0adfff380829', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:01 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 1073741824 Sep 28 17:17:01 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8c9595-4434-41e1-b0dd-c9656fb4b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-f2853e67-fbed-42ed-99f4-0adfff380829 (f2853e67-fbed-42ed-99f4-0adfff380829): created successfully Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8c9595-4434-41e1-b0dd-c9656fb4b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (50cc4db4-9ce9-47a6-a629-646ff23445d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7f274dfa-0a65-4b9a-970f-64de520e3447 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:17:02 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 1073741824" returned: 0 in 0.731s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 Sep 28 17:17:02 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:02 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502" returned: 0 in 0.416s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-917db3c2-0724-4ab0-a782-08df3cc849f6 req-51f9cce4-2c05-4e91-80ed-c62ea6813d4d tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.343s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c60502-d185-4966-ac45-06cd4bc1ff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2def94bf-8519-4dad-aa94-75ea5925a502', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd2967a-6622-4cea-a7cf-c2ac7b67391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-917db3c2-0724-4ab0-a782-08df3cc849f6 req-51f9cce4-2c05-4e91-80ed-c62ea6813d4d tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Volume volume-2def94bf-8519-4dad-aa94-75ea5925a502 (2def94bf-8519-4dad-aa94-75ea5925a502): created successfully Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd2967a-6622-4cea-a7cf-c2ac7b67391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Flow 'volume_create_manager' (bf1bc523-1713-4a49-b225-561aa89effd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:03 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.442s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-089bb096-7070-4997-837f-5b31b0896c0e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created volume successfully. Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-917db3c2-0724-4ab0-a782-08df3cc849f6 req-51f9cce4-2c05-4e91-80ed-c62ea6813d4d tempest-TestInstancesWithCinderVolumes-1576522316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-c15a908d-5803-45c6-8f20-306f691cbeac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b2ffa42-4845-4dab-9f7a-da515b5da367', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-917db3c2-0724-4ab0-a782-08df3cc849f6 req-51f9cce4-2c05-4e91-80ed-c62ea6813d4d tempest-TestInstancesWithCinderVolumes-1576522316 None] attachment_update completed successfully. Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-2def94bf-8519-4dad-aa94-75ea5925a502-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-2def94bf-8519-4dad-aa94-75ea5925a502-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-2def94bf-8519-4dad-aa94-75ea5925a502" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-2def94bf-8519-4dad-aa94-75ea5925a502" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f499a17-9577-4dcb-ad87-d92947ca3a64]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 Sep 28 17:17:03 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502" returned: 0 in 0.701s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502 Sep 28 17:17:04 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-31fd85d6-6ef0-4223-a6b3-ac2586630a05 tempest-GroupsV320Test-2022372036 None] Group tempest-GroupsV320Test-Group-800489325: creating Sep 28 17:17:04 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2def94bf-8519-4dad-aa94-75ea5925a502" returned: 0 in 0.648s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-2def94bf-8519-4dad-aa94-75ea5925a502" released by "delete_volume" :: held 1.428s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-31fd85d6-6ef0-4223-a6b3-ac2586630a05 tempest-GroupsV320Test-2022372036 None] Group tempest-GroupsV320Test-Group-800489325: created successfully Sep 28 17:17:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-31fd85d6-6ef0-4223-a6b3-ac2586630a05 tempest-GroupsV320Test-2022372036 None] Create group completed successfully. Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['1e2b55bd-6dd6-473b-b4af-318b09c98dc6', '7831f19f-a054-47ea-a3b4-7255c6739d14', 'a7f5ddbb-79e4-45f7-980c-807987b276e9', 'a1f99314-c523-4613-bf18-a658605e9294'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:05 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.453s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8023131c-4a24-4987-9b37-1f6ee9a011c8 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-2def94bf-8519-4dad-aa94-75ea5925a502-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-f2853e67-fbed-42ed-99f4-0adfff380829-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-f2853e67-fbed-42ed-99f4-0adfff380829-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-f2853e67-fbed-42ed-99f4-0adfff380829" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-f2853e67-fbed-42ed-99f4-0adfff380829" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4efea-1fa9-4350-888a-38db6e07c016]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 Sep 28 17:17:06 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5479b157-42aa-4125-bd59-0bbeaf68b56e req-fe7fbcfc-fac5-4b87-adb4-72504f39fd71 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5479b157-42aa-4125-bd59-0bbeaf68b56e req-fe7fbcfc-fac5-4b87-adb4-72504f39fd71 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5479b157-42aa-4125-bd59-0bbeaf68b56e req-fe7fbcfc-fac5-4b87-adb4-72504f39fd71 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-5479b157-42aa-4125-bd59-0bbeaf68b56e req-fe7fbcfc-fac5-4b87-adb4-72504f39fd71 tempest-TestInstancesWithCinderVolumes-1576522316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-49f5664f-5afb-4195-b0cf-563bca8b350d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7da57890-7d03-4a3d-ac50-1350cc5298d6', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:17:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-5479b157-42aa-4125-bd59-0bbeaf68b56e req-fe7fbcfc-fac5-4b87-adb4-72504f39fd71 tempest-TestInstancesWithCinderVolumes-1576522316 None] attachment_update completed successfully. Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Created reservations ['c86417a2-d34b-4ebd-9005-50b42c3f0672'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:06 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829" returned: 0 in 0.628s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829 Sep 28 17:17:06 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:06 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f2853e67-fbed-42ed-99f4-0adfff380829" returned: 0 in 0.471s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-f2853e67-fbed-42ed-99f4-0adfff380829" released by "delete_volume" :: held 1.199s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:07 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.433s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a5875610-2f7d-412a-be81-6329e613ce7d tempest-GroupsV320Test-2022372036 None] Delete group completed successfully. Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['4c4cc9e6-b657-4388-93a2-47d781eb8a93', '55eb2a2c-79f7-4e3f-a00e-e0517437b5bb', 'ae76606b-f3b9-4239-9561-3014532c15ec', '04afa62b-f98e-49dc-8263-1a1f70c930bb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:07 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:07 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.370s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-adf485c8-7adb-4c01-8533-d49cf5d8d11a tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-f2853e67-fbed-42ed-99f4-0adfff380829-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-53449d82-ed97-4e09-a36b-596e49443e70-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-53449d82-ed97-4e09-a36b-596e49443e70-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-53449d82-ed97-4e09-a36b-596e49443e70" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-53449d82-ed97-4e09-a36b-596e49443e70" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b836b-d212-486e-b637-45cedaca3077]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 Sep 28 17:17:08 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70" returned: 0 in 0.599s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70 Sep 28 17:17:09 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-53449d82-ed97-4e09-a36b-596e49443e70" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-53449d82-ed97-4e09-a36b-596e49443e70" released by "delete_volume" :: held 1.063s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['b552440b-8d4f-48f3-aa4b-5af6453baf92', 'db2ed1cd-c534-43fa-a541-327af6dc91ca', 'ef147089-e13e-42a8-b894-4f813dd71ed9', 'd823af30-c69a-4c6b-bfcc-c5dcb1f289b2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:09 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.419s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-eabbe4c8-e6fd-4541-b24c-4a7bfb5be59e tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-53449d82-ed97-4e09-a36b-596e49443e70-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-7a76fda0-b97a-43fc-a25f-05b4120a824e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-7a76fda0-b97a-43fc-a25f-05b4120a824e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-7a76fda0-b97a-43fc-a25f-05b4120a824e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-7a76fda0-b97a-43fc-a25f-05b4120a824e" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[df20482a-7da8-4143-9656-75e5471b50d3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e Sep 28 17:17:11 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:11 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e" returned: 0 in 0.706s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e Sep 28 17:17:11 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:12 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7a76fda0-b97a-43fc-a25f-05b4120a824e" returned: 0 in 0.631s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-7a76fda0-b97a-43fc-a25f-05b4120a824e" released by "delete_volume" :: held 1.416s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['ae760ca8-8bbd-4ad4-997e-55e8bd95b808', '35a86b9c-d846-4f0f-9394-25aa7f88e67f', '5fbb7fb5-28ab-4a09-a0e9-4ee9f39ba0a0', 'f553e8fd-3c01-4e2e-9f40-7bdceb9940a0'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:12 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:13 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.503s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3eb2b658-a60f-4aa5-ad5a-b080dd058d82 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-7a76fda0-b97a-43fc-a25f-05b4120a824e-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-8a842bb0-9bcb-472b-8d31-d1d0be820b2a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-8a842bb0-9bcb-472b-8d31-d1d0be820b2a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dd7ea8-0457-40da-9319-95c2d7fd0b47]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:13 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a Sep 28 17:17:13 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:14 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" returned: 0 in 0.695s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:14 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a Sep 28 17:17:14 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:14 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" returned: 0 in 0.601s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-8a842bb0-9bcb-472b-8d31-d1d0be820b2a" released by "delete_volume" :: held 1.421s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:14 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['dc902e01-ebfe-47fb-8462-22808b27a3d4', 'fcdda5b7-3523-4075-ba0e-196cf29b38dc', '1765e8d7-7fc3-40ef-ab29-65b5e0bdb6b3', '24a90b27-3cdf-4575-8a5c-346528326c10'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:15 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:15 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-eb3a2986-7dc6-4fb9-930a-33a0e4d56990 req-02c6e2b3-f258-4118-beca-06ae3f5fd9c5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Terminate volume connection completed successfully. Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-eb3a2986-7dc6-4fb9-930a-33a0e4d56990 req-02c6e2b3-f258-4118-beca-06ae3f5fd9c5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleting attachment 3b2ffa42-4845-4dab-9f7a-da515b5da367. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-9c98208d-efec-462d-96db-6981d524a9a6-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-9c98208d-efec-462d-96db-6981d524a9a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-9c98208d-efec-462d-96db-6981d524a9a6" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:15 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-9c98208d-efec-462d-96db-6981d524a9a6" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleting offline snapshot 9c98208d-efec-462d-96db-6981d524a9a6 of volume 291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] snapshot_file for this snap is: volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.817s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:15 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:16 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[187806b7-e541-4cc3-a302-11b102d6dc75]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c34bae00-36d2-4cc8-84a2-cf098cfc0e7c tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-8a842bb0-9bcb-472b-8d31-d1d0be820b2a-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:16 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 Sep 28 17:17:16 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:16 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6" returned: 0 in 0.558s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-291631d8-a8fa-42eb-9928-7e86e859dfa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f5aa65-49f6-4d3f-868f-65c15085436d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-c15a908d-5803-45c6-8f20-306f691cbeac-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-c15a908d-5803-45c6-8f20-306f691cbeac-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-quobyte-c15a908d-5803-45c6-8f20-306f691cbeac" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-c15a908d-5803-45c6-8f20-306f691cbeac" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[da244fb9-81bc-4d4d-a214-0572d9f494c0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:17 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:17 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:17 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac Sep 28 17:17:17 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:17 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9" returned: 0 in 0.923s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:17 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 Sep 28 17:17:17 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:18 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac" returned: 0 in 0.935s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:18 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac Sep 28 17:17:18 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:18 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6" returned: 0 in 0.757s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:18 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6 Sep 28 17:17:18 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:18 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a908d-5803-45c6-8f20-306f691cbeac" returned: 0 in 0.527s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-c15a908d-5803-45c6-8f20-306f691cbeac" released by "delete_volume" :: held 1.555s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:18 devstack cinder-volume[87034]: WARNING cinder.quota [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017509807-678861556 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017509807-678861556, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:18 devstack cinder-volume[87034]: WARNING cinder.quota [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017509807-678861556 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1017509807-678861556, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Created reservations ['20fb61e7-1a80-4ec4-a03a-09408e95c1cc', '428c0544-da00-43bc-9142-528a90b88c16', '763fce6f-91c5-44c5-ad62-a06a0767d326', '50dac7a1-40ba-4b25-9bc3-92324fa65ee3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:18 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:18 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:18 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9.9c98208d-efec-462d-96db-6981d524a9a6" returned: 0 in 0.613s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-9c98208d-efec-462d-96db-6981d524a9a6" released by "_delete_snapshot" :: held 3.122s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" released by "delete_snapshot" :: held 3.201s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['3a893d5f-ad38-4671-a1bb-7b4467159e2d', '52237aa5-3bdd-4347-a7bb-7a952d8e1b4b', 'f797004c-0f99-4209-b4b4-aa40e4db654d', 'f8f21ecd-3d19-4b49-ac77-9e07e7a00343'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Delete snapshot completed successfully. Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-47a82b33-9d27-4e0a-b10b-b7beab2ad713 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-9c98208d-efec-462d-96db-6981d524a9a6-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:19 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.554s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleted volume successfully. Sep 28 17:17:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee956043-4389-4748-9e41-33c6b871570f tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-c15a908d-5803-45c6-8f20-306f691cbeac-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-291631d8-a8fa-42eb-9928-7e86e859dfa9-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-291631d8-a8fa-42eb-9928-7e86e859dfa9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5dbfa9-ba62-45c4-9acb-1bbb5e2e2458]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:20 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 Sep 28 17:17:20 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:21 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9" returned: 0 in 0.959s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:21 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9 Sep 28 17:17:21 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:22 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-291631d8-a8fa-42eb-9928-7e86e859dfa9" returned: 0 in 0.425s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-quobyte-291631d8-a8fa-42eb-9928-7e86e859dfa9" released by "delete_volume" :: held 1.521s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Created reservations ['c87f3566-b905-42c8-b5b7-697284a70dce', '366e3802-be4d-43b5-91bb-55a08ad471da', '167ffe16-1749-4244-aae9-fdde708592c0', 'e6dfa7ec-9f44-432b-b727-496f273e093b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:22 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:22 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:22 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Deleted volume successfully. Sep 28 17:17:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d79992f6-a77c-42b2-a2c7-68b51b1a1674 tempest-CreateVolumesFromSnapshotTest-1304904410 None] Lock "cinder-291631d8-a8fa-42eb-9928-7e86e859dfa9-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-28f170ee-2acd-4174-b425-0022b327f349 req-ae63371a-d846-4bd6-9565-adef1f1d2eec tempest-TestInstancesWithCinderVolumes-1576522316 None] Terminate volume connection completed successfully. Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-28f170ee-2acd-4174-b425-0022b327f349 req-ae63371a-d846-4bd6-9565-adef1f1d2eec tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleting attachment 7da57890-7d03-4a3d-ac50-1350cc5298d6. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-49f5664f-5afb-4195-b0cf-563bca8b350d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-49f5664f-5afb-4195-b0cf-563bca8b350d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-quobyte-49f5664f-5afb-4195-b0cf-563bca8b350d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-49f5664f-5afb-4195-b0cf-563bca8b350d" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc030c6f-4853-4842-9a22-11a0a134470e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d Sep 28 17:17:24 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d" returned: 0 in 0.687s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d Sep 28 17:17:24 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-49f5664f-5afb-4195-b0cf-563bca8b350d" returned: 0 in 0.388s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-49f5664f-5afb-4195-b0cf-563bca8b350d" released by "delete_volume" :: held 1.179s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:24 devstack cinder-volume[87034]: WARNING cinder.quota [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172384658-67751471 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172384658-67751471, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:24 devstack cinder-volume[87034]: WARNING cinder.quota [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172384658-67751471 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-172384658-67751471, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Created reservations ['22ae80be-9c1f-4ac1-bf8c-d642ddf898fc', '1f65ea8a-534a-4de3-ad13-64413f3e4159', '3d89552b-5b2d-4b6f-8288-71a56b38e323', 'e04306a1-5663-447e-89fd-67d69275bd78'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:25 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:25 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:25 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.358s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleted volume successfully. Sep 28 17:17:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-20d04f66-9503-4d75-a50d-404dcb643ea5 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-49f5664f-5afb-4195-b0cf-563bca8b350d-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=97,cinder:UPDATE=114,cinder:DELETE=7,cinder:INSERT=26 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Flow 'volume_create_manager' (bd411ffe-13bb-42e2-8bd9-3b590be17fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c075499-c325-42e7-88e0-8e916a826d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c075499-c325-42e7-88e0-8e916a826d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b694ef0c812455a90c7bd6c40ef05c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:35Z,use_quota=True,user_id='f7616727408a421f8acdbbd1425dfe77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20a1c49-1e7f-4b10-b10f-224bfb452d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20a1c49-1e7f-4b10-b10f-224bfb452d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2c5ab5-adb0-4643-86fc-9fd63f60dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2c5ab5-adb0-4643-86fc-9fd63f60dc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0', 'volume_name': 'volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0', 'volume_size': 1, 'image_id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51c5dd6d0b27f65545a96c9112333c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b694ef0c812455a90c7bd6c40ef05c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b03551772b740789cdd9149bb9ff5cde23f47fd021c7a29a4e8e01ee279748c63b7344cb359ffbee88abe76bde1a8436cf546244dd0b5644cbf5f69583e0770', 'id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9288d6da-ca99-44db-ab0d-3e9732035650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9288d6da-ca99-44db-ab0d-3e9732035650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc80f8-125b-414c-8973-458f086be40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0', 'volume_size': 1, 'image_id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51c5dd6d0b27f65545a96c9112333c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b694ef0c812455a90c7bd6c40ef05c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b03551772b740789cdd9149bb9ff5cde23f47fd021c7a29a4e8e01ee279748c63b7344cb359ffbee88abe76bde1a8436cf546244dd0b5644cbf5f69583e0770', 'id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a/file', 'properties': {}}, 'image_service': } Sep 28 17:17:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Trying to clone 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 from image 0c4e7072-f65d-41ad-ad08-2212fd397a1a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:17:36 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:17:36 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:17:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8de07-111f-4737-9ee3-408908d950e7]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-d8a1a13c-9a6f-4aca-adda-d391d6661302 req-138100af-5c83-4fe6-ad1e-1e13c99dcf09 tempest-TestInstancesWithCinderVolumes-1576522316 None] Terminate volume connection completed successfully. Sep 28 17:17:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-d8a1a13c-9a6f-4aca-adda-d391d6661302 req-138100af-5c83-4fe6-ad1e-1e13c99dcf09 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleting attachment b84a3845-9b58-47ab-ba67-8762ea872983. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:36 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:36 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 0 in 0.676s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:37 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 1 in 0.628s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Temporary image 0c4e7072-f65d-41ad-ad08-2212fd397a1a is fetched for user f7616727408a421f8acdbbd1425dfe77. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc500a-0251-4c4a-9752-365592891a28]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:37 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:38 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 1 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b694ef0c812455a90c7bd6c40ef05c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:35Z,use_quota=True,user_id='f7616727408a421f8acdbbd1425dfe77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Creating volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1073741824 Sep 28 17:17:38 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-c43290d6-e5e1-4bf1-9761-ee5e5707784e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-c43290d6-e5e1-4bf1-9761-ee5e5707784e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "cinder-quobyte-c43290d6-e5e1-4bf1-9761-ee5e5707784e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-c43290d6-e5e1-4bf1-9761-ee5e5707784e" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[84195c12-d237-4b81-9e2f-b8df569ce6a6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e Sep 28 17:17:39 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1073741824" returned: 0 in 0.855s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 Sep 28 17:17:39 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e" returned: 0 in 0.622s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e Sep 28 17:17:39 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" returned: 0 in 0.397s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Attempting download of 0c4e7072-f65d-41ad-ad08-2212fd397a1a ((None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}])) to volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:17:40 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7bb720-e8c1-4ed0-a0c0-c9543e4ed0dd]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c43290d6-e5e1-4bf1-9761-ee5e5707784e" returned: 0 in 0.447s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-quobyte-c43290d6-e5e1-4bf1-9761-ee5e5707784e" released by "delete_volume" :: held 1.171s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:40 devstack cinder-volume[87034]: WARNING cinder.quota [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412748787-82681873 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412748787-82681873, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:40 devstack cinder-volume[87034]: WARNING cinder.quota [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412748787-82681873 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412748787-82681873, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Created reservations ['41e9315b-cf10-4c30-835d-b5a1227856eb', '4bf4621c-e24b-4cca-b08e-6434fdbae24d', 'caec7120-727a-4e7f-b41c-b665fb987af0', 'f0fce0a3-142a-43d3-a3e9-3412a86fbcf6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:40 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:40 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:40 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h" returned: 0 in 0.580s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:40 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Deleted volume successfully. Sep 28 17:17:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8c3e4aef-d266-4768-8f9d-6d364cb4b8a2 tempest-TestInstancesWithCinderVolumes-1576522316 None] Lock "cinder-c43290d6-e5e1-4bf1-9761-ee5e5707784e-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:41 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h Sep 28 17:17:41 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:41 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h" returned: 1 in 0.483s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c4e7072-f65d-41ad-ad08-2212fd397a1a_6e0ll38h' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c1219f-5b3b-4583-991c-4206446462e6]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:41 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:41 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:42 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:42 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD Sep 28 17:17:42 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:42 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD" returned: 1 in 0.549s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] 0c4e7072-f65d-41ad-ad08-2212fd397a1a was raw, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:17:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:42 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 Sep 28 17:17:42 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:43 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" returned: 0 in 0.648s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c4e7072-f65d-41ad-ad08-2212fd397a1a__sm90sosdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:43 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:43 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1G Sep 28 17:17:43 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:43 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 1G" returned: 0 in 0.501s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Downloaded image 0c4e7072-f65d-41ad-ad08-2212fd397a1a ((None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}])) to volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Temporary image 0c4e7072-f65d-41ad-ad08-2212fd397a1a for user f7616727408a421f8acdbbd1425dfe77 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Marking volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Copying metadata from image 0c4e7072-f65d-41ad-ad08-2212fd397a1a to 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Creating volume glance metadata for volume 2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 backed by image 0c4e7072-f65d-41ad-ad08-2212fd397a1a with: {'image_id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51c5dd6d0b27f65545a96c9112333c75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bc80f8-125b-414c-8973-458f086be40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0', 'volume_size': 1, 'image_id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51c5dd6d0b27f65545a96c9112333c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4b694ef0c812455a90c7bd6c40ef05c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7b03551772b740789cdd9149bb9ff5cde23f47fd021c7a29a4e8e01ee279748c63b7344cb359ffbee88abe76bde1a8436cf546244dd0b5644cbf5f69583e0770', 'id': '0c4e7072-f65d-41ad-ad08-2212fd397a1a', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c4e7072-f65d-41ad-ad08-2212fd397a1a/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ab6b1f-a3be-4fc0-913d-a017b51f02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Volume volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 (2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0): created successfully Sep 28 17:17:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ab6b1f-a3be-4fc0-913d-a017b51f02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Flow 'volume_create_manager' (bd411ffe-13bb-42e2-8bd9-3b590be17fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4df9ef09-4127-49d9-be92-064186cf3592 tempest-VolumeImageDependencyTests-1188170835 None] Created volume successfully. Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Acquiring lock "cinder-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "cinder-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Acquiring lock "cinder-quobyte-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "cinder-quobyte-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c13e49e-0033-4529-953f-a215e5fe9b27]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 Sep 28 17:17:45 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" returned: 0 in 0.613s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:46 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0 Sep 28 17:17:46 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" returned: 0 in 0.553s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "cinder-quobyte-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0" released by "delete_volume" :: held 1.259s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Created reservations ['ce35add1-6470-4e0b-a130-8ae4054ac666', '483bccfa-7ab9-46f7-878b-76df79dd4394', '2f1292d6-70f8-43d5-9b5e-03860e4a4b5c', 'f5d760f1-2896-4271-89be-dacf95a55e41'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:46 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:46 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:47 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.381s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Deleted volume successfully. Sep 28 17:17:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-69c3d489-707b-4bbe-a197-b66ba1e8eb57 tempest-VolumeImageDependencyTests-1188170835 None] Lock "cinder-2b4f28d2-1e3d-44db-9eb7-09e5cbcbcdd0-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=119,cinder:UPDATE=138,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Flow 'volume_create_manager' (d2189beb-7081-4aa0-8c1f-f56bc33c9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b6be86-a322-458d-9481-b61a6ce07558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b6be86-a322-458d-9481-b61a6ce07558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1831549069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78e6f33-8308-40d0-8bda-a984bad5990d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50d2e041724f6380ad63a1d4b173c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:50Z,use_quota=True,user_id='ea0c284434454cd6895ec2c14ef15340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(544227cb-2a5b-4c90-ab40-79a7c16a1ab2),volume_type_id=544227cb-2a5b-4c90-ab40-79a7c16a1ab2)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27924e9-0ede-4a90-af04-92affca36967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27924e9-0ede-4a90-af04-92affca36967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fd89a5-53d9-4545-bc72-00977ad68292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fd89a5-53d9-4545-bc72-00977ad68292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78e6f33-8308-40d0-8bda-a984bad5990d', 'volume_name': 'volume-a78e6f33-8308-40d0-8bda-a984bad5990d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efc831-1c1e-41ab-bff8-c8ec68b62b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39efc831-1c1e-41ab-bff8-c8ec68b62b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9516402-3c9d-40e6-96d2-8fa91ad11258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Volume a78e6f33-8308-40d0-8bda-a984bad5990d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78e6f33-8308-40d0-8bda-a984bad5990d', 'volume_size': 1} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1831549069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78e6f33-8308-40d0-8bda-a984bad5990d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d50d2e041724f6380ad63a1d4b173c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:50Z,use_quota=True,user_id='ea0c284434454cd6895ec2c14ef15340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(544227cb-2a5b-4c90-ab40-79a7c16a1ab2),volume_type_id=544227cb-2a5b-4c90-ab40-79a7c16a1ab2)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Creating volume a78e6f33-8308-40d0-8bda-a984bad5990d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:50 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:50 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d 1073741824 Sep 28 17:17:50 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:51 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d 1073741824" returned: 0 in 0.753s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:51 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d Sep 28 17:17:51 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:51 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d" returned: 0 in 0.451s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9516402-3c9d-40e6-96d2-8fa91ad11258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78e6f33-8308-40d0-8bda-a984bad5990d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75314bdf-4da3-4574-9012-595e9a395531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Volume volume-a78e6f33-8308-40d0-8bda-a984bad5990d (a78e6f33-8308-40d0-8bda-a984bad5990d): created successfully Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75314bdf-4da3-4574-9012-595e9a395531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Flow 'volume_create_manager' (d2189beb-7081-4aa0-8c1f-f56bc33c9407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d056858a-01dd-41ee-8877-ccfb6f68ed28 tempest-VolumeTypesAccessTest-1737781309 None] Created volume successfully. Sep 28 17:17:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Acquiring lock "cinder-a78e6f33-8308-40d0-8bda-a984bad5990d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "cinder-a78e6f33-8308-40d0-8bda-a984bad5990d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Acquiring lock "cinder-quobyte-a78e6f33-8308-40d0-8bda-a984bad5990d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "cinder-quobyte-a78e6f33-8308-40d0-8bda-a984bad5990d" acquired by "delete_volume" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:53 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ead5cc-41a6-4b7a-99dc-cad07ec6db0c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:53 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d Sep 28 17:17:53 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:54 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d" returned: 0 in 0.998s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:54 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d Sep 28 17:17:54 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:54 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a78e6f33-8308-40d0-8bda-a984bad5990d" returned: 0 in 0.467s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "cinder-quobyte-a78e6f33-8308-40d0-8bda-a984bad5990d" released by "delete_volume" :: held 1.613s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:54 devstack cinder-volume[87034]: WARNING cinder.quota [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1261913659 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1261913659, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:54 devstack cinder-volume[87034]: WARNING cinder.quota [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1261913659 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1261913659, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Created reservations ['9e810c22-89c7-4fc6-a728-38dcc11618fa', '4d8d6879-88fd-462a-921e-b38f5dd80e60', '8bad02fc-4d12-4542-81a1-c6645e6c3e84', '34d7f5a8-5b5b-46ba-b09b-872e8cbb94e7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:54 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:17:54 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Flow 'volume_create_manager' (794aeb3a-a3c3-4829-b137-54473c709dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f819ed-b7a9-4117-9b0c-98030c98c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f819ed-b7a9-4117-9b0c-98030c98c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdace71-58a6-4e6d-b484-38737289d6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5feab36eb048888b8067e2861a28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:55Z,use_quota=True,user_id='3042f6fd465e4fceb29875100b675b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8eb1da-6352-437d-88bf-b886ef6a08ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8eb1da-6352-437d-88bf-b886ef6a08ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53802f5f-5f51-4c2d-ba48-71cafbe3d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53802f5f-5f51-4c2d-ba48-71cafbe3d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdace71-58a6-4e6d-b484-38737289d6f8', 'volume_name': 'volume-0cdace71-58a6-4e6d-b484-38737289d6f8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd785ef-4b85-4e34-ace2-4acbb427479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd785ef-4b85-4e34-ace2-4acbb427479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7426fa-ba83-41c0-9832-1dfcbee2674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Volume 0cdace71-58a6-4e6d-b484-38737289d6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdace71-58a6-4e6d-b484-38737289d6f8', 'volume_size': 1} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdace71-58a6-4e6d-b484-38737289d6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5feab36eb048888b8067e2861a28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:55Z,use_quota=True,user_id='3042f6fd465e4fceb29875100b675b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Creating volume 0cdace71-58a6-4e6d-b484-38737289d6f8 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:55 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.760s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:55 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 1073741824 Sep 28 17:17:55 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Deleted volume successfully. Sep 28 17:17:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f206a406-1bc8-46eb-ba24-0738cf086ac6 tempest-VolumeTypesAccessTest-1737781309 None] Lock "cinder-a78e6f33-8308-40d0-8bda-a984bad5990d-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:56 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 1073741824" returned: 0 in 1.159s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:56 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 Sep 28 17:17:56 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:57 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8" returned: 0 in 0.440s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d7426fa-ba83-41c0-9832-1dfcbee2674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdace71-58a6-4e6d-b484-38737289d6f8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1957969-d8fc-4c43-975b-ac4b50601fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Volume volume-0cdace71-58a6-4e6d-b484-38737289d6f8 (0cdace71-58a6-4e6d-b484-38737289d6f8): created successfully Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1957969-d8fc-4c43-975b-ac4b50601fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Flow 'volume_create_manager' (794aeb3a-a3c3-4829-b137-54473c709dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-454eddd0-1e84-4954-8061-cf6251728007 tempest-CinderUnicodeTest-1240481087 None] Created volume successfully. Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Flow 'volume_create_manager' (7987303e-82a9-491a-8794-9e790f209aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08269a7-83f4-4a4d-88c8-04ae280168ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08269a7-83f4-4a4d-88c8-04ae280168ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810818102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e22f2b-b467-4644-ae18-d01efa3f59c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5feab36eb048888b8067e2861a28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:59Z,use_quota=True,user_id='3042f6fd465e4fceb29875100b675b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd55395-ee66-4f15-ab09-52eb53d15253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd55395-ee66-4f15-ab09-52eb53d15253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c138ee5-4822-465d-9af6-3b26c8cca51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c138ee5-4822-465d-9af6-3b26c8cca51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e22f2b-b467-4644-ae18-d01efa3f59c3', 'volume_name': 'volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed76fd3-40f9-4151-89ee-63e43851e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed76fd3-40f9-4151-89ee-63e43851e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef5316-7518-4d73-b873-00c0a520485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Volume d4e22f2b-b467-4644-ae18-d01efa3f59c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3', 'volume_size': 1} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810818102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e22f2b-b467-4644-ae18-d01efa3f59c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5feab36eb048888b8067e2861a28a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:59Z,use_quota=True,user_id='3042f6fd465e4fceb29875100b675b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Creating volume d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 1073741824 Sep 28 17:17:59 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 1073741824" returned: 0 in 0.670s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 Sep 28 17:17:59 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3" returned: 0 in 0.369s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef5316-7518-4d73-b873-00c0a520485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009892d-ae0b-4f6c-bc32-34a407500f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Volume volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 (d4e22f2b-b467-4644-ae18-d01efa3f59c3): created successfully Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9009892d-ae0b-4f6c-bc32-34a407500f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Flow 'volume_create_manager' (7987303e-82a9-491a-8794-9e790f209aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-be5f1e1b-43c7-418e-a6da-1aea46ea77ec tempest-CinderUnicodeTest-1240481087 None] Created volume successfully. Sep 28 17:18:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Creating offline snapshot 639f86cb-ff8f-439d-8914-5b3f6dc2e7da of volume d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee134c1-5d9f-4e9a-a567-f104927adafd]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 Sep 28 17:18:01 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3" returned: 0 in 0.794s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da 1G Sep 28 17:18:02 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:02 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:03 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da 1G" returned: 0 in 0.919s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.552s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:03 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da Sep 28 17:18:03 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da" returned: 0 in 0.809s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da is being set with open permissions: ugo+rw Sep 28 17:18:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da Sep 28 17:18:04 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info Sep 28 17:18:04 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info" returned: 0 in 0.552s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info is being set with open permissions: ugo+rw Sep 28 17:18:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:05 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info Sep 28 17:18:05 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.info" returned: 0 in 0.427s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.136s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-811549ef-e427-4df6-8aef-2c8223884295 tempest-CinderUnicodeTest-1240481087 None] Create snapshot completed successfully Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-639f86cb-ff8f-439d-8914-5b3f6dc2e7da-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-639f86cb-ff8f-439d-8914-5b3f6dc2e7da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-quobyte-639f86cb-ff8f-439d-8914-5b3f6dc2e7da" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-639f86cb-ff8f-439d-8914-5b3f6dc2e7da" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Deleting offline snapshot 639f86cb-ff8f-439d-8914-5b3f6dc2e7da of volume d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] snapshot_file for this snap is: volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6376a1e-9d86-465b-9c47-ebacd77378ba]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da Sep 28 17:18:07 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da" returned: 0 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:07 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[10440662-b102-4053-824b-2045ba61ceb5]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 Sep 28 17:18:07 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3" returned: 0 in 0.616s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da Sep 28 17:18:08 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da" returned: 0 in 0.475s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da Sep 28 17:18:08 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3.639f86cb-ff8f-439d-8914-5b3f6dc2e7da" returned: 0 in 0.346s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-639f86cb-ff8f-439d-8914-5b3f6dc2e7da" released by "_delete_snapshot" :: held 2.107s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" released by "delete_snapshot" :: held 2.147s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:09 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Created reservations ['324e5bb8-cf54-4f4c-a588-2bc4bb8cd8fa', '40875538-f333-405b-9786-570471f8e908', 'a7c3082a-0555-463f-ab3e-0c398b3af50d', 'e32ba71b-1bec-41e4-b9d4-c9a09223a9bc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Delete snapshot completed successfully. Sep 28 17:18:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ec5c786e-282e-4660-9736-5966de90169c tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-639f86cb-ff8f-439d-8914-5b3f6dc2e7da-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-d4e22f2b-b467-4644-ae18-d01efa3f59c3-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Flow 'volume_create_manager' (566ee54c-fb91-4984-9276-831b1be0c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e790d1-4ff5-4d50-b1d3-0445d58b3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-d4e22f2b-b467-4644-ae18-d01efa3f59c3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e790d1-4ff5-4d50-b1d3-0445d58b3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2958086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64377fd2-4f93-478e-8652-3195f266e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de8c424e66e453fa15863cafd07b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:10Z,use_quota=True,user_id='1ba0dc00900848549548f5eef2036c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f8a90-5da7-417c-84bf-261ddd083b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7f8a90-5da7-417c-84bf-261ddd083b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f07f45-5008-46d5-9983-c1b66ff95833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f07f45-5008-46d5-9983-c1b66ff95833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64377fd2-4f93-478e-8652-3195f266e95d', 'volume_name': 'volume-64377fd2-4f93-478e-8652-3195f266e95d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2c25bd-03ae-48e9-a4a2-ac3c1054ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2c25bd-03ae-48e9-a4a2-ac3c1054ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ed9a9e-2922-4ecf-9cc1-c3270f951feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Volume 64377fd2-4f93-478e-8652-3195f266e95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64377fd2-4f93-478e-8652-3195f266e95d', 'volume_size': 1} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2958086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64377fd2-4f93-478e-8652-3195f266e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de8c424e66e453fa15863cafd07b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:10Z,use_quota=True,user_id='1ba0dc00900848549548f5eef2036c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Creating volume 64377fd2-4f93-478e-8652-3195f266e95d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:10 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:10 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d 1073741824 Sep 28 17:18:10 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea3b6b-8f54-4682-96ef-2211d4699fe9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:10 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 Sep 28 17:18:10 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:10 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d 1073741824" returned: 0 in 0.615s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:11 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d Sep 28 17:18:11 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:11 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3" returned: 0 in 0.541s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:11 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3 Sep 28 17:18:11 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:11 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d" returned: 0 in 0.308s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ed9a9e-2922-4ecf-9cc1-c3270f951feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64377fd2-4f93-478e-8652-3195f266e95d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd046aa-cfc3-4143-aa34-e4c297efaf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:11 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d4e22f2b-b467-4644-ae18-d01efa3f59c3" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Volume volume-64377fd2-4f93-478e-8652-3195f266e95d (64377fd2-4f93-478e-8652-3195f266e95d): created successfully Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd046aa-cfc3-4143-aa34-e4c297efaf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Flow 'volume_create_manager' (566ee54c-fb91-4984-9276-831b1be0c574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-d4e22f2b-b467-4644-ae18-d01efa3f59c3" released by "delete_volume" :: held 0.954s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:11 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-17ccf78e-3f02-4527-9de6-d7d4909127fe tempest-ProjectReaderTests-1628523840 None] Created volume successfully. Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Created reservations ['929d72d2-7673-48d2-a7a2-7956c632a896', '0e6d476b-853c-4cdd-875f-e7d7ab64791a', '38abb7eb-e679-4a35-b77a-005430ba5538', '12d2ccf4-9263-4a25-9848-7ea381220cbc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:11 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:11 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:11 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.306s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:11 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Deleted volume successfully. Sep 28 17:18:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f21e5bdf-d6a1-4e84-948e-5dc6503acc08 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-d4e22f2b-b467-4644-ae18-d01efa3f59c3-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-0cdace71-58a6-4e6d-b484-38737289d6f8-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Acquiring lock "cinder-64377fd2-4f93-478e-8652-3195f266e95d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-0cdace71-58a6-4e6d-b484-38737289d6f8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "cinder-64377fd2-4f93-478e-8652-3195f266e95d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "cinder-quobyte-0cdace71-58a6-4e6d-b484-38737289d6f8" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-0cdace71-58a6-4e6d-b484-38737289d6f8" acquired by "delete_volume" :: waited 0.058s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Acquiring lock "cinder-quobyte-64377fd2-4f93-478e-8652-3195f266e95d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc5a6a-8e2a-433a-ab39-403526e98701]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "cinder-quobyte-64377fd2-4f93-478e-8652-3195f266e95d" acquired by "delete_volume" :: waited 0.042s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[836f1519-c5f6-4848-bfd9-5e455e743bd5]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:12 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 Sep 28 17:18:12 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d Sep 28 17:18:13 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8" returned: 0 in 0.609s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:13 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8 Sep 28 17:18:13 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d" returned: 0 in 0.639s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:13 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d Sep 28 17:18:13 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0cdace71-58a6-4e6d-b484-38737289d6f8" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-quobyte-0cdace71-58a6-4e6d-b484-38737289d6f8" released by "delete_volume" :: held 1.090s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Created reservations ['38cc515c-0f82-4d12-9e2d-8e36dec61fb1', '12313dfa-fe4d-4927-9e6e-d60eb7eda254', '0b747aac-eafc-4ad8-a492-9c078e6ad7d2', '6dc94a31-c9ce-476f-81fc-cb810325a851'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:13 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-64377fd2-4f93-478e-8652-3195f266e95d" returned: 0 in 0.449s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "cinder-quobyte-64377fd2-4f93-478e-8652-3195f266e95d" released by "delete_volume" :: held 1.166s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:13 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:14 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Created reservations ['4aeaa5cf-ecd0-4f7b-8539-f8615915e153', '3f6dcf76-9244-4628-85ee-27c84836dc26', '0fe55b84-86f0-42ab-9e24-863cb1679902', 'e1dee4f9-1f30-4c74-98f6-9f4ba570e1dc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:14 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:14 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:14 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Deleted volume successfully. Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-38149541-4d8c-45f6-ac58-7115a0b3d714 tempest-CinderUnicodeTest-1240481087 None] Lock "cinder-0cdace71-58a6-4e6d-b484-38737289d6f8-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:14 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.313s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Deleted volume successfully. Sep 28 17:18:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efef3ed8-15e2-4b82-821f-75bf090d937e tempest-ProjectReaderTests-1628523840 None] Lock "cinder-64377fd2-4f93-478e-8652-3195f266e95d-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Flow 'volume_create_manager' (dbd80416-af5d-40c8-878a-9003c0c3010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b81adb7-2dcc-4310-8c3d-2631521b9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b81adb7-2dcc-4310-8c3d-2631521b9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235067171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de8c424e66e453fa15863cafd07b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:15Z,use_quota=True,user_id='1ba0dc00900848549548f5eef2036c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377d068-ff6b-42f8-add8-890d653b4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f377d068-ff6b-42f8-add8-890d653b4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436c1d6-71ed-42d1-83f9-e2cf20de556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436c1d6-71ed-42d1-83f9-e2cf20de556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa', 'volume_name': 'volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a305d8-6173-4ded-9851-c727016886ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a305d8-6173-4ded-9851-c727016886ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4433e6-76cc-48fd-9d7c-269d407e5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:15 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Volume 6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa', 'volume_size': 1} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235067171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de8c424e66e453fa15863cafd07b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:15Z,use_quota=True,user_id='1ba0dc00900848549548f5eef2036c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Creating volume 6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:15 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:15 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa 1073741824 Sep 28 17:18:15 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:16 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa 1073741824" returned: 0 in 0.613s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:16 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa Sep 28 17:18:16 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:16 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4433e6-76cc-48fd-9d7c-269d407e5995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7134d855-522a-4e95-b58b-2695aa63be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Volume volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa (6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa): created successfully Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7134d855-522a-4e95-b58b-2695aa63be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Flow 'volume_create_manager' (dbd80416-af5d-40c8-878a-9003c0c3010e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:16 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-786aea77-4a77-4b61-89dd-174093cd4b3f tempest-ProjectReaderTests-1628523840 None] Created volume successfully. Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Acquiring lock "cinder-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "cinder-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Acquiring lock "cinder-quobyte-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "cinder-quobyte-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[644162cf-fc2f-4c36-a57e-ed4fc5783b1c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:18 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa Sep 28 17:18:18 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:18 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" returned: 0 in 0.782s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:18 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa Sep 28 17:18:18 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:19 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" returned: 0 in 0.488s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "cinder-quobyte-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa" released by "delete_volume" :: held 1.376s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Created reservations ['ec5cd436-a3c3-450b-a523-323ad56de986', '944a9d45-8549-464b-87a0-6456a0463357', '438a4b04-c9d6-4c46-a2ca-1e580a9a6da3', '057a8ce3-d1f1-47e9-8c15-e4e85675bc1e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:19 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:19 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:20 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.457s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:20 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:20 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Deleted volume successfully. Sep 28 17:18:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e051a7d6-14e2-42f8-894c-ed618883ad53 tempest-ProjectReaderTests-1628523840 None] Lock "cinder-6d9c9fb9-6c5d-4bf1-92c1-75a5b228a3fa-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Flow 'volume_create_manager' (8458235a-1a80-41f8-84aa-1fa49741670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a9239e-f439-4253-8123-453f092cb3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a9239e-f439-4253-8123-453f092cb3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1992028601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed937e9d-0955-4e43-97d7-c776ba9c035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea08e499c7474fbf57c8631e5bc4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:24Z,use_quota=True,user_id='d673a7c1a8044887954c23d621d7e3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9addfc-dbd2-45df-b8a5-ace2a2f88784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9addfc-dbd2-45df-b8a5-ace2a2f88784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634a9390-c1ce-476f-8876-21aa3f22453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634a9390-c1ce-476f-8876-21aa3f22453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed937e9d-0955-4e43-97d7-c776ba9c035f', 'volume_name': 'volume-ed937e9d-0955-4e43-97d7-c776ba9c035f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daabeb1-ce5e-441c-b9b5-f8eb0a465433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daabeb1-ce5e-441c-b9b5-f8eb0a465433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346e09d2-648d-45eb-9eaf-1f76529b1966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Volume ed937e9d-0955-4e43-97d7-c776ba9c035f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed937e9d-0955-4e43-97d7-c776ba9c035f', 'volume_size': 1} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1992028601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed937e9d-0955-4e43-97d7-c776ba9c035f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8ea08e499c7474fbf57c8631e5bc4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:24Z,use_quota=True,user_id='d673a7c1a8044887954c23d621d7e3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Creating volume ed937e9d-0955-4e43-97d7-c776ba9c035f {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:24 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:24 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f 1073741824 Sep 28 17:18:24 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:24 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f 1073741824" returned: 0 in 0.708s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:24 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f Sep 28 17:18:24 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:25 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f" returned: 0 in 0.322s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346e09d2-648d-45eb-9eaf-1f76529b1966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed937e9d-0955-4e43-97d7-c776ba9c035f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae3514a-4845-44cf-8a08-b8109046ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Volume volume-ed937e9d-0955-4e43-97d7-c776ba9c035f (ed937e9d-0955-4e43-97d7-c776ba9c035f): created successfully Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae3514a-4845-44cf-8a08-b8109046ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Flow 'volume_create_manager' (8458235a-1a80-41f8-84aa-1fa49741670b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-705f70c5-e48a-4b67-804b-a57430485b72 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Created volume successfully. Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Flow 'volume_create_manager' (68d5ffad-13fd-4704-9cf3-fc7b291d110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1383ac9b-99c4-482c-930b-e309b73cd994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1383ac9b-99c4-482c-930b-e309b73cd994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1617834247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c2b527-6339-40a1-b9db-27331c503300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af259e1559414e09879e10de214f948a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:25Z,use_quota=True,user_id='2be6e1d6b75e48579a5b104421a19879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42048fa1-93e9-4708-9436-c12a38360483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42048fa1-93e9-4708-9436-c12a38360483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf905bc-8403-479b-8803-42520f7fb566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf905bc-8403-479b-8803-42520f7fb566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c2b527-6339-40a1-b9db-27331c503300', 'volume_name': 'volume-92c2b527-6339-40a1-b9db-27331c503300', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa3ddaa-ed6a-4355-a2eb-5bf66475ae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa3ddaa-ed6a-4355-a2eb-5bf66475ae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab605317-8681-4a95-b6d1-7ae7dd687c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Volume 92c2b527-6339-40a1-b9db-27331c503300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c2b527-6339-40a1-b9db-27331c503300', 'volume_size': 1} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1617834247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c2b527-6339-40a1-b9db-27331c503300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af259e1559414e09879e10de214f948a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:25Z,use_quota=True,user_id='2be6e1d6b75e48579a5b104421a19879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Creating volume 92c2b527-6339-40a1-b9db-27331c503300 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:25 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:25 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 1073741824 Sep 28 17:18:25 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:26 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 1073741824" returned: 0 in 0.632s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:26 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 Sep 28 17:18:26 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:26 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab605317-8681-4a95-b6d1-7ae7dd687c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c2b527-6339-40a1-b9db-27331c503300', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a9001-293c-4e90-b09c-af145ac67199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Volume volume-92c2b527-6339-40a1-b9db-27331c503300 (92c2b527-6339-40a1-b9db-27331c503300): created successfully Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18a9001-293c-4e90-b09c-af145ac67199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Flow 'volume_create_manager' (68d5ffad-13fd-4704-9cf3-fc7b291d110e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e560ab97-8375-4c7d-8887-84fdf6f5903e tempest-VolumesTransfersV355Test-190608293 None] Created volume successfully. Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-9027ec70-a3be-44e7-9f86-f55af0d26f37 req-265e69b9-6f5e-4350-b24d-978a8e9724ae tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-9027ec70-a3be-44e7-9f86-f55af0d26f37 req-265e69b9-6f5e-4350-b24d-978a8e9724ae tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-9027ec70-a3be-44e7-9f86-f55af0d26f37 req-265e69b9-6f5e-4350-b24d-978a8e9724ae tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-9027ec70-a3be-44e7-9f86-f55af0d26f37 req-265e69b9-6f5e-4350-b24d-978a8e9724ae tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-ed937e9d-0955-4e43-97d7-c776ba9c035f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd19cbc11-73b6-4554-a0c8-6cc47ffbede4', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-9027ec70-a3be-44e7-9f86-f55af0d26f37 req-265e69b9-6f5e-4350-b24d-978a8e9724ae tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] attachment_update completed successfully. Sep 28 17:18:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-273ea3ba-d66b-4757-a70b-4c11d19d5b4e tempest-VolumesTransfersV355Test-1645953488 None] Transfer volume completed successfully. Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "cinder-92c2b527-6339-40a1-b9db-27331c503300-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-92c2b527-6339-40a1-b9db-27331c503300-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "cinder-quobyte-92c2b527-6339-40a1-b9db-27331c503300" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-quobyte-92c2b527-6339-40a1-b9db-27331c503300" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a750935-bd95-4e0a-aad9-5fd345c68751]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:29 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 Sep 28 17:18:29 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:30 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300" returned: 0 in 0.533s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:30 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300 Sep 28 17:18:30 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:30 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-92c2b527-6339-40a1-b9db-27331c503300" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-quobyte-92c2b527-6339-40a1-b9db-27331c503300" released by "delete_volume" :: held 0.982s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Created reservations ['b864b6c5-b91b-4f71-8429-0be31c903236', '711cb92a-6987-4d3b-85bf-790e712a9869', 'cb96fe91-06cf-425a-91dc-69d12138e7ec', 'e5c1df62-9197-4dc5-a86d-21b57773691b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:30 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:31 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:31 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.303s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:31 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Deleted volume successfully. Sep 28 17:18:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-793a56d3-0a7d-40b8-861c-bd0b512f72f8 tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-92c2b527-6339-40a1-b9db-27331c503300-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-4a708f66-15f8-46e6-9a82-bac34a05a665 req-a568ea7f-d4bb-46b8-b6f7-f989879df802 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Terminate volume connection completed successfully. Sep 28 17:18:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-4a708f66-15f8-46e6-9a82-bac34a05a665 req-a568ea7f-d4bb-46b8-b6f7-f989879df802 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Deleting attachment d19cbc11-73b6-4554-a0c8-6cc47ffbede4. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "cinder-ed937e9d-0955-4e43-97d7-c776ba9c035f-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "cinder-ed937e9d-0955-4e43-97d7-c776ba9c035f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "cinder-quobyte-ed937e9d-0955-4e43-97d7-c776ba9c035f" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "cinder-quobyte-ed937e9d-0955-4e43-97d7-c776ba9c035f" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adecaf3-97d6-49dc-8e0b-3f3f6fc76cd2]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:32 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f Sep 28 17:18:32 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:32 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Flow 'volume_create_manager' (cba40a07-29a7-42e7-af60-47d1bebd61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76411f7a-265a-415f-8a11-4f969df05eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76411f7a-265a-415f-8a11-4f969df05eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-652251256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59f6d7f-9df0-4429-a8a6-1afff5c3d319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af259e1559414e09879e10de214f948a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:33Z,use_quota=True,user_id='2be6e1d6b75e48579a5b104421a19879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22c587-9de9-483e-8766-3d337bef3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef22c587-9de9-483e-8766-3d337bef3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3dda1e5-93ea-4d12-b37b-061723cd772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3dda1e5-93ea-4d12-b37b-061723cd772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59f6d7f-9df0-4429-a8a6-1afff5c3d319', 'volume_name': 'volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fb4469-73c7-4bb1-823e-bdc9114115c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fb4469-73c7-4bb1-823e-bdc9114115c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb70fcc-9d7e-4d7c-9dfd-f138b8474bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Volume d59f6d7f-9df0-4429-a8a6-1afff5c3d319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319', 'volume_size': 1} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-652251256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59f6d7f-9df0-4429-a8a6-1afff5c3d319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af259e1559414e09879e10de214f948a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:33Z,use_quota=True,user_id='2be6e1d6b75e48579a5b104421a19879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Creating volume d59f6d7f-9df0-4429-a8a6-1afff5c3d319 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:33 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 1073741824 Sep 28 17:18:33 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:33 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f" returned: 0 in 0.574s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f Sep 28 17:18:33 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:33 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ed937e9d-0955-4e43-97d7-c776ba9c035f" returned: 0 in 0.445s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "cinder-quobyte-ed937e9d-0955-4e43-97d7-c776ba9c035f" released by "delete_volume" :: held 1.139s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Created reservations ['0f998a2f-78b4-4d6d-a573-360bfa13db4a', '3efbe74a-6bb9-4259-9443-a38a10fbcb76', '2ecd4ac5-3d35-4507-9e2f-c7359b040c2a', '784487cd-e302-40e8-b0a6-191dc62afefa'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:33 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 1073741824" returned: 0 in 0.750s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 Sep 28 17:18:33 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:34 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:34 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:34 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" returned: 0 in 0.427s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb70fcc-9d7e-4d7c-9dfd-f138b8474bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7c746d-ef34-411a-ab9e-a51730ba2d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Volume volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 (d59f6d7f-9df0-4429-a8a6-1afff5c3d319): created successfully Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7c746d-ef34-411a-ab9e-a51730ba2d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Flow 'volume_create_manager' (cba40a07-29a7-42e7-af60-47d1bebd61a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-fb18dd1b-6d34-48fd-84c4-2bd8c7881d1f tempest-VolumesTransfersV355Test-190608293 None] Created volume successfully. Sep 28 17:18:34 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.483s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Deleted volume successfully. Sep 28 17:18:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee7157ff-6850-44cc-b095-fac0bcf3d6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1949976676 None] Lock "cinder-ed937e9d-0955-4e43-97d7-c776ba9c035f-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "cinder-d59f6d7f-9df0-4429-a8a6-1afff5c3d319-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-d59f6d7f-9df0-4429-a8a6-1afff5c3d319-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:35 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=88,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=11 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "cinder-quobyte-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-quobyte-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fee5d5-5496-42fb-b966-c9efcb566705]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:36 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 Sep 28 17:18:36 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:36 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" returned: 0 in 0.519s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:36 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319 Sep 28 17:18:36 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:37 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" returned: 0 in 0.358s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-quobyte-d59f6d7f-9df0-4429-a8a6-1afff5c3d319" released by "delete_volume" :: held 0.956s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Created reservations ['dba824ad-c291-4c87-8fe5-31f8ce02671a', '43a9bf66-c123-46c3-8c08-4e4be3231824', '784ee7cc-ae53-4b35-842d-eb3606b02565', 'ce7f3203-2467-47ed-95bb-eb15256ab6d0'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:37 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:18:37 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:37 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.356s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Deleted volume successfully. Sep 28 17:18:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-482df7c8-325e-4980-b501-0d02ef439c3c tempest-VolumesTransfersV355Test-1069852554 None] Lock "cinder-d59f6d7f-9df0-4429-a8a6-1afff5c3d319-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:47 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=100,cinder:INSERT=23,cinder:SELECT=72,cinder:DELETE=6 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:47 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Flow 'volume_create_manager' (199ab791-bb74-4b38-b172-394281a6d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c01970d-b67f-4c4f-9fcf-f387eabfdc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c01970d-b67f-4c4f-9fcf-f387eabfdc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475515736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9ba669-c152-4e58-9fbc-5c12a30052e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdec913f4384a81b993f0ef27abd587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:58Z,use_quota=True,user_id='9bb9c91693af44af8f97bef3d4b5f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33f271-094a-4376-9cf0-6567d1d469c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33f271-094a-4376-9cf0-6567d1d469c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e31d445-55df-455f-bbb8-6f739fe2a3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e31d445-55df-455f-bbb8-6f739fe2a3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9ba669-c152-4e58-9fbc-5c12a30052e8', 'volume_name': 'volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26b2d66-d523-47a3-9b00-507556051b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26b2d66-d523-47a3-9b00-507556051b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75b4568-115e-4eaa-81b2-ce576bdb3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Volume 6b9ba669-c152-4e58-9fbc-5c12a30052e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8', 'volume_size': 1} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475515736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9ba669-c152-4e58-9fbc-5c12a30052e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdec913f4384a81b993f0ef27abd587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:58Z,use_quota=True,user_id='9bb9c91693af44af8f97bef3d4b5f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Creating volume 6b9ba669-c152-4e58-9fbc-5c12a30052e8 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:58 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:58 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 1073741824 Sep 28 17:18:58 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:58 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 1073741824" returned: 0 in 0.674s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:58 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 Sep 28 17:18:58 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:59 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8" returned: 0 in 0.329s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75b4568-115e-4eaa-81b2-ce576bdb3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459c3a2e-71b9-4cc4-8151-ca78cdec3f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Volume volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 (6b9ba669-c152-4e58-9fbc-5c12a30052e8): created successfully Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459c3a2e-71b9-4cc4-8151-ca78cdec3f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Flow 'volume_create_manager' (199ab791-bb74-4b38-b172-394281a6d531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b68f8cfe-53bc-455e-b59d-e772d132f754 tempest-VolumesTransfersV357Test-399642550 None] Created volume successfully. Sep 28 17:19:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-944f8e41-7458-4cb2-8648-1980f498fcf4 tempest-VolumesTransfersV357Test-2142001698 None] Transfer volume completed successfully. Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Flow 'volume_create_manager' (43268f35-3435-491d-a599-b09304e38a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd13d5c-4eb3-43a2-ae07-88281193e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd13d5c-4eb3-43a2-ae07-88281193e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-675221457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065d475af598496b9541e53b096c5acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:02Z,use_quota=True,user_id='909f3abe5f434a0d8bb71ab5e6bf2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af76afa1-5e01-4faa-991c-c1bf29ec17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af76afa1-5e01-4faa-991c-c1bf29ec17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8665edc-6789-4b99-ab3f-558bcb247322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8665edc-6789-4b99-ab3f-558bcb247322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb', 'volume_name': 'volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e44afb1-0679-4a3e-9d53-bdd1d846cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e44afb1-0679-4a3e-9d53-bdd1d846cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafe0b94-c06a-43e5-be66-704a0c7f3cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Volume bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb', 'volume_size': 1} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-675221457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065d475af598496b9541e53b096c5acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:02Z,use_quota=True,user_id='909f3abe5f434a0d8bb71ab5e6bf2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Creating volume bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:01 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:01 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb 1073741824 Sep 28 17:19:01 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "cinder-6b9ba669-c152-4e58-9fbc-5c12a30052e8-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-6b9ba669-c152-4e58-9fbc-5c12a30052e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "cinder-quobyte-6b9ba669-c152-4e58-9fbc-5c12a30052e8" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-quobyte-6b9ba669-c152-4e58-9fbc-5c12a30052e8" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[631e2bdf-a750-41c0-abcf-26566bac784c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:02 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb 1073741824" returned: 0 in 0.719s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:02 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 Sep 28 17:19:02 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:02 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:02 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:02 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:02 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:02 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8" returned: 0 in 0.491s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:02 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8 Sep 28 17:19:02 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:03 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.411s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafe0b94-c06a-43e5-be66-704a0c7f3cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82d8c3b-e3bc-4da4-b3b9-975c9f48dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.374s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Volume volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb (bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb): created successfully Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82d8c3b-e3bc-4da4-b3b9-975c9f48dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Flow 'volume_create_manager' (43268f35-3435-491d-a599-b09304e38a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cf5c655a-a57e-49cd-900a-dcded5c5d566 tempest-SnapshotDependencyTests-95809525 None] Created volume successfully. Sep 28 17:19:03 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6b9ba669-c152-4e58-9fbc-5c12a30052e8" returned: 0 in 0.356s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-quobyte-6b9ba669-c152-4e58-9fbc-5c12a30052e8" released by "delete_volume" :: held 0.897s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Created reservations ['7d99e49f-588f-4b1b-ba6b-a2487260a15c', '854d36cb-c916-4f6d-b8b2-3706c9b2bbde', '0db477a1-ac8b-4f51-9cfa-7bc01134103a', 'b9fcabdf-eb6e-4595-92f3-bfdeee468a97'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:03 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:03 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:03 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.460s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Deleted volume successfully. Sep 28 17:19:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7d518488-0add-41b4-a5a5-085362ffc00b tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-6b9ba669-c152-4e58-9fbc-5c12a30052e8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Flow 'volume_create_manager' (187885f7-e971-4815-b3d3-30eab1231bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d43864-2312-4e5d-9067-3e994c6a4b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Creating offline snapshot 459b8484-d1fc-451c-813b-053b3c64cbe7 of volume bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d43864-2312-4e5d-9067-3e994c6a4b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1127382647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a54aacc-1de9-4911-9e97-2d8f022e2817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdec913f4384a81b993f0ef27abd587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:05Z,use_quota=True,user_id='9bb9c91693af44af8f97bef3d4b5f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45fad48-00ec-49be-8c2c-c35fe8e08149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45fad48-00ec-49be-8c2c-c35fe8e08149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c16b01-2abd-4096-9c02-a0235dc81443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c16b01-2abd-4096-9c02-a0235dc81443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a54aacc-1de9-4911-9e97-2d8f022e2817', 'volume_name': 'volume-8a54aacc-1de9-4911-9e97-2d8f022e2817', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaef808-45f5-40ba-960d-ba74d15d1789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaef808-45f5-40ba-960d-ba74d15d1789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e22ffd-b793-4062-9eda-6f806d22d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:04 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Volume 8a54aacc-1de9-4911-9e97-2d8f022e2817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a54aacc-1de9-4911-9e97-2d8f022e2817', 'volume_size': 1} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9f8e68-a251-48c4-9768-928c9cf9b45e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:04 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:04 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:05 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.526s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:05 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 1G Sep 28 17:19:05 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:05 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 1G" returned: 0 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:05 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:05 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:06 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:06 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 is being set with open permissions: ugo+rw Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:06 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:06 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:06 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.274s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:06 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info Sep 28 17:19:06 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:06 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info" returned: 0 in 0.320s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:06 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info is being set with open permissions: ugo+rw Sep 28 17:19:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:06 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info Sep 28 17:19:06 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.info" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.364s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1127382647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a54aacc-1de9-4911-9e97-2d8f022e2817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdec913f4384a81b993f0ef27abd587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:05Z,use_quota=True,user_id='9bb9c91693af44af8f97bef3d4b5f3a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Creating volume 8a54aacc-1de9-4911-9e97-2d8f022e2817 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:07 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:07 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 1073741824 Sep 28 17:19:07 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7a2fc97c-9195-437c-9035-9b4e8f6daeef tempest-SnapshotDependencyTests-95809525 None] Create snapshot completed successfully Sep 28 17:19:07 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 1073741824" returned: 0 in 0.627s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:07 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 Sep 28 17:19:07 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:08 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817" returned: 0 in 0.349s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e22ffd-b793-4062-9eda-6f806d22d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a54aacc-1de9-4911-9e97-2d8f022e2817', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250d115f-bb59-4754-be10-fd4be0611d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Volume volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 (8a54aacc-1de9-4911-9e97-2d8f022e2817): created successfully Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250d115f-bb59-4754-be10-fd4be0611d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Flow 'volume_create_manager' (187885f7-e971-4815-b3d3-30eab1231bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b06cc228-f81d-466c-9fe3-69ec597e091c tempest-VolumesTransfersV357Test-399642550 None] Created volume successfully. Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Flow 'volume_create_manager' (16405b04-655e-400b-a920-7b8eaa31a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803ed304-dfaf-480e-a9b8-4e6557feab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803ed304-dfaf-480e-a9b8-4e6557feab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1aa3079-1867-4dc2-a63a-03642e869c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065d475af598496b9541e53b096c5acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=459b8484-d1fc-451c-813b-053b3c64cbe7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:08Z,use_quota=True,user_id='909f3abe5f434a0d8bb71ab5e6bf2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f35f4e-b665-43ec-b41a-868cfb13d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f35f4e-b665-43ec-b41a-868cfb13d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ddb7c3-3c1d-414b-9913-0e272b9add82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ddb7c3-3c1d-414b-9913-0e272b9add82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1aa3079-1867-4dc2-a63a-03642e869c67', 'volume_name': 'volume-b1aa3079-1867-4dc2-a63a-03642e869c67', 'volume_size': 1, 'snapshot_id': '459b8484-d1fc-451c-813b-053b3c64cbe7'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0003e44b-ef38-438c-9e2e-c800147e38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0003e44b-ef38-438c-9e2e-c800147e38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc58eeb-b906-4026-91ef-5b1405ebb4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Volume b1aa3079-1867-4dc2-a63a-03642e869c67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1aa3079-1867-4dc2-a63a-03642e869c67', 'volume_size': 1, 'snapshot_id': '459b8484-d1fc-451c-813b-053b3c64cbe7'} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7-b1aa3079-1867-4dc2-a63a-03642e869c67" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7-b1aa3079-1867-4dc2-a63a-03642e869c67" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Creating volume b1aa3079-1867-4dc2-a63a-03642e869c67 from snapshot 459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] snapshot: 459b8484-d1fc-451c-813b-053b3c64cbe7, volume: b1aa3079-1867-4dc2-a63a-03642e869c67, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c1f0c7-6c87-4570-8bd4-910675a4abf9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:08 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:08 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "cinder-8a54aacc-1de9-4911-9e97-2d8f022e2817-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-8a54aacc-1de9-4911-9e97-2d8f022e2817-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "cinder-quobyte-8a54aacc-1de9-4911-9e97-2d8f022e2817" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-quobyte-8a54aacc-1de9-4911-9e97-2d8f022e2817" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:09 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.561s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a61a3-5543-4ec6-bc53-c68dc31178e6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c692f-41dd-4155-81d4-1da97f4ef7f9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:09 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 Sep 28 17:19:09 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (812fc312-e5bf-42e0-87ba-b050dd673fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:09 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:09 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc89d68-d2a2-4c24-81f9-ccfa9cff4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc89d68-d2a2-4c24-81f9-ccfa9cff4b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043882954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e47ff7-c576-4dfd-a4f3-e615c5909bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:09Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0960f3a0-ed6c-4f90-a070-4f71244da35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0960f3a0-ed6c-4f90-a070-4f71244da35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8ce6ea-d10e-41ad-812d-20de879e45ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8ce6ea-d10e-41ad-812d-20de879e45ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e47ff7-c576-4dfd-a4f3-e615c5909bc7', 'volume_name': 'volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafb6c1d-f23c-4cb7-abc8-67910d2c0e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafb6c1d-f23c-4cb7-abc8-67910d2c0e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79d76f2-b838-4389-ad32-dfbc0f4d6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume 05e47ff7-c576-4dfd-a4f3-e615c5909bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7', 'volume_size': 1} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:09 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817" returned: 0 in 0.447s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:09 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.451s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:19:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:09 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817 Sep 28 17:19:09 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:09 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 Sep 28 17:19:09 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:10 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a54aacc-1de9-4911-9e97-2d8f022e2817" returned: 0 in 0.324s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-quobyte-8a54aacc-1de9-4911-9e97-2d8f022e2817" released by "delete_volume" :: held 0.838s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Created reservations ['6cb917bd-bcb6-4dbd-9c58-86e2904f7c91', 'bc540094-9dbb-40dc-b35a-7e37113cce1e', 'dc50dd20-db58-4eac-8e6d-3bc7cd86611f', '692f7b0a-3131-4cf5-9cce-03cd46b44b21'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:10 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:10 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:10 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.513s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Deleted volume successfully. Sep 28 17:19:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2b7fe569-a08a-4aec-a124-ded2485c7168 tempest-VolumesTransfersV357Test-798411131 None] Lock "cinder-8a54aacc-1de9-4911-9e97-2d8f022e2817-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67" returned: 0 in 7.398s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:17 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Converted 1024.00 MB image at 138.40 MB/s Sep 28 17:19:17 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 is being set with open permissions: ugo+rw Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 Sep 28 17:19:17 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67" returned: 0 in 0.281s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" released by "_copy_volume_from_snapshot" :: held 8.827s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7-b1aa3079-1867-4dc2-a63a-03642e869c67" released by "_create_volume_from_snapshot" :: held 8.907s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.931s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.969s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043882954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e47ff7-c576-4dfd-a4f3-e615c5909bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:09Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume 05e47ff7-c576-4dfd-a4f3-e615c5909bc7 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:17 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 1073741824 Sep 28 17:19:17 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc58eeb-b906-4026-91ef-5b1405ebb4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1aa3079-1867-4dc2-a63a-03642e869c67', 'volume_size': 1, 'snapshot_id': '459b8484-d1fc-451c-813b-053b3c64cbe7'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f964e424-4df7-4a9e-85d7-c81755a524e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Volume volume-b1aa3079-1867-4dc2-a63a-03642e869c67 (b1aa3079-1867-4dc2-a63a-03642e869c67): created successfully Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f964e424-4df7-4a9e-85d7-c81755a524e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Flow 'volume_create_manager' (16405b04-655e-400b-a920-7b8eaa31a994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5c7c513a-6382-41e5-82aa-8550db99bc40 tempest-SnapshotDependencyTests-95809525 None] Created volume successfully. Sep 28 17:19:18 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 1073741824" returned: 0 in 0.545s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 Sep 28 17:19:18 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" returned: 0 in 0.256s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79d76f2-b838-4389-ad32-dfbc0f4d6076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd0adc4-2924-4343-8083-287a8e100631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:18 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 (05e47ff7-c576-4dfd-a4f3-e615c5909bc7): created successfully Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd0adc4-2924-4343-8083-287a8e100631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (812fc312-e5bf-42e0-87ba-b050dd673fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:18 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-733e4733-1d94-4b92-9aec-4a7ea73562d1 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-459b8484-d1fc-451c-813b-053b3c64cbe7-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-459b8484-d1fc-451c-813b-053b3c64cbe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Deleting offline snapshot 459b8484-d1fc-451c-813b-053b3c64cbe7 of volume bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] snapshot_file for this snap is: volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27a9aef-3fd4-4276-890c-6212e39d239d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:18 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.413s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b7168-30c1-414f-beec-331caba697f1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:19 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.592s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:19 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (09956b76-a882-4083-8133-809e27b9d3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4801f7b4-377e-48d7-b91e-4332d40804f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4801f7b4-377e-48d7-b91e-4332d40804f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1287370299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80defc1d-a706-4bd0-a1f9-42f5f5b5dde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:20Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9a66a-2ab1-41dc-928a-a72f58fd9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9a66a-2ab1-41dc-928a-a72f58fd9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee6dd77-b8af-403e-aaf9-d47b9c92a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee6dd77-b8af-403e-aaf9-d47b9c92a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80defc1d-a706-4bd0-a1f9-42f5f5b5dde9', 'volume_name': 'volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe64e17-5689-41df-ab1e-4c465e3d7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe64e17-5689-41df-ab1e-4c465e3d7019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe0a3aa-7304-4631-b697-56fee6ddc8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume 80defc1d-a706-4bd0-a1f9-42f5f5b5dde9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9', 'volume_size': 1} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:20 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1287370299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80defc1d-a706-4bd0-a1f9-42f5f5b5dde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:20Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume 80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:20 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.667s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 1073741824 Sep 28 17:19:20 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7 Sep 28 17:19:20 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (fc6c51b9-8928-4f8b-9b7b-7e9ce14af675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368616b7-790e-4f36-bcec-7b2991f68c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368616b7-790e-4f36-bcec-7b2991f68c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935825480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5c7011-4461-47f2-965d-a302fc200cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:21Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fb50cd-3584-4966-b7bc-3e9821f389c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fb50cd-3584-4966-b7bc-3e9821f389c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcd42e-cca6-41ca-b179-656471e13788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcd42e-cca6-41ca-b179-656471e13788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5c7011-4461-47f2-965d-a302fc200cb2', 'volume_name': 'volume-6e5c7011-4461-47f2-965d-a302fc200cb2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a9f949-3ebb-43e9-b2b7-f40c79a56f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a9f949-3ebb-43e9-b2b7-f40c79a56f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e64f532-b32a-4008-b917-999449d6ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume 6e5c7011-4461-47f2-965d-a302fc200cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5c7011-4461-47f2-965d-a302fc200cb2', 'volume_size': 1} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb.459b8484-d1fc-451c-813b-053b3c64cbe7" returned: 0 in 0.449s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-459b8484-d1fc-451c-813b-053b3c64cbe7" released by "_delete_snapshot" :: held 2.259s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" released by "delete_snapshot" :: held 2.293s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Created reservations ['3ce0755c-2d1f-4240-82b9-2d448abd5012', 'cb0d85e3-36c6-4b9e-b233-e76b11dbcb94', 'be984af5-c3a3-41a7-9341-4ae9e36d041b', 'a91b053e-279f-4a26-9f6d-423bf6b4f62a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Delete snapshot completed successfully. Sep 28 17:19:21 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-49968e72-6c1c-4461-a746-9b2f3243762f tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-459b8484-d1fc-451c-813b-053b3c64cbe7-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 1073741824" returned: 0 in 0.832s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 Sep 28 17:19:21 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (94a097d5-6596-46b4-bcaa-5f90bf4c8e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b3a577-694b-4053-b644-be569c5e6a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b3a577-694b-4053-b644-be569c5e6a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1768797780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1438c-13e1-4687-b564-2f37ff889d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:21Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b2bb0-25ef-48ce-8914-64da8cbcf808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594b2bb0-25ef-48ce-8914-64da8cbcf808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08bfeb6-dab3-469a-add1-8a0cc5467479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08bfeb6-dab3-469a-add1-8a0cc5467479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e1438c-13e1-4687-b564-2f37ff889d61', 'volume_name': 'volume-e8e1438c-13e1-4687-b564-2f37ff889d61', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a759aa-fe0f-4ccd-a7d4-09e1f4abd016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a759aa-fe0f-4ccd-a7d4-09e1f4abd016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b749642-51ea-405f-8a4a-b0792973bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume e8e1438c-13e1-4687-b564-2f37ff889d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e1438c-13e1-4687-b564-2f37ff889d61', 'volume_size': 1} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" returned: 0 in 0.472s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935825480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5c7011-4461-47f2-965d-a302fc200cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:21Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume 6e5c7011-4461-47f2-965d-a302fc200cb2 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe0a3aa-7304-4631-b697-56fee6ddc8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 1073741824 Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e130c8d2-8f9b-4b15-9226-931dce17f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 (80defc1d-a706-4bd0-a1f9-42f5f5b5dde9): created successfully Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e130c8d2-8f9b-4b15-9226-931dce17f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (09956b76-a882-4083-8133-809e27b9d3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5ce2bf85-239e-474b-bf01-8f02e01d8b10 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (30128fbe-c98f-4d4a-a236-9ad8845584df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41be237b-6f1e-417c-a971-f48c9718339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41be237b-6f1e-417c-a971-f48c9718339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967509336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15211333-3591-4822-935c-ffe73ca0401c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179e864-e31b-457b-831c-a7a93264dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179e864-e31b-457b-831c-a7a93264dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b062805-15cf-4489-987e-546bab2548fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b062805-15cf-4489-987e-546bab2548fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15211333-3591-4822-935c-ffe73ca0401c', 'volume_name': 'volume-15211333-3591-4822-935c-ffe73ca0401c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26903556-2b88-46ff-a1ff-0a50947fa22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26903556-2b88-46ff-a1ff-0a50947fa22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9496a286-76e2-4d54-b703-ecc3c6f2b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume 15211333-3591-4822-935c-ffe73ca0401c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15211333-3591-4822-935c-ffe73ca0401c', 'volume_size': 1} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Flow 'volume_create_manager' (37347978-9a73-4c7c-b790-769a8e34c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d56f508-8ba2-46ec-949c-01f6653ce662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d56f508-8ba2-46ec-949c-01f6653ce662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-964094132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b90d30870f840d8b6a76454089677bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='345c6486f0a4419fa185382687447b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2e6557-ac65-435f-9a4d-cc37ffa30c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2e6557-ac65-435f-9a4d-cc37ffa30c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a05ae0-2dc0-4ffd-8b22-d45434d0d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a05ae0-2dc0-4ffd-8b22-d45434d0d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'volume_name': 'volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515435a0-6f13-4958-8613-823203eda070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515435a0-6f13-4958-8613-823203eda070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd0b71-224b-4757-9fb6-d7d7a7a70288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Volume 8a1bcf40-62c5-4bb0-93f3-6f2060f5602d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'volume_size': 1} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" acquired by "delete_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d6fea-adee-4a1e-9858-c36b6424e277]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (7020bfd4-964b-4033-8e9e-192690e7fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab11a0d1-2964-437d-a43b-afd2989bc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab11a0d1-2964-437d-a43b-afd2989bc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-152154624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbd6883-be17-4449-a19b-295cdb9e2f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cf1b2d-4e78-4106-a603-643c4f518a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cf1b2d-4e78-4106-a603-643c4f518a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20996728-4d46-4e15-8d7e-250fcf5f7996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20996728-4d46-4e15-8d7e-250fcf5f7996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbd6883-be17-4449-a19b-295cdb9e2f95', 'volume_name': 'volume-0dbd6883-be17-4449-a19b-295cdb9e2f95', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befc428d-241b-4826-bd5b-d23d559b7e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befc428d-241b-4826-bd5b-d23d559b7e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d19f0-5ad8-4076-8cfe-3d5f98822209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume 0dbd6883-be17-4449-a19b-295cdb9e2f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbd6883-be17-4449-a19b-295cdb9e2f95', 'volume_size': 1} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 1073741824" returned: 0 in 0.834s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:22 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:22 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:22 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 Sep 28 17:19:22 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:22 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2" returned: 0 in 0.305s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:22 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1768797780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e1438c-13e1-4687-b564-2f37ff889d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:21Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume e8e1438c-13e1-4687-b564-2f37ff889d61 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:22 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e64f532-b32a-4008-b917-999449d6ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5c7011-4461-47f2-965d-a302fc200cb2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed43d18-3c60-4a18-965b-7ef9409e4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 1073741824 Sep 28 17:19:23 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-6e5c7011-4461-47f2-965d-a302fc200cb2 (6e5c7011-4461-47f2-965d-a302fc200cb2): created successfully Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed43d18-3c60-4a18-965b-7ef9409e4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:23 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb Sep 28 17:19:23 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (fc6c51b9-8928-4f8b-9b7b-7e9ce14af675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-478ba96f-999a-4aeb-91f1-bac575594f64 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:23 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb" released by "delete_volume" :: held 0.922s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Created reservations ['79056fda-3027-4691-b307-7e9f41a297fa', '024991b6-9aa5-482b-907d-ed4026d40705', 'fcdd6d32-baa7-4228-ba88-4da41cd7b7fb', 'b3bdb7f6-2138-4e7b-b126-ccfb3cc7725f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:23 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 1073741824" returned: 0 in 0.598s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 Sep 28 17:19:23 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.311s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Deleted volume successfully. Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5667f0e8-3e42-4a13-a14b-96a1053581f9 tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-bfc0f0d8-c309-4a19-8eda-b5f9fcbb22bb-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:23 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61" returned: 0 in 0.311s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967509336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15211333-3591-4822-935c-ffe73ca0401c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume 15211333-3591-4822-935c-ffe73ca0401c {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:23 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b749642-51ea-405f-8a4a-b0792973bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e1438c-13e1-4687-b564-2f37ff889d61', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc3320c-5af9-4299-8d74-1461b0bef77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:23 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c 1073741824 Sep 28 17:19:23 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-e8e1438c-13e1-4687-b564-2f37ff889d61 (e8e1438c-13e1-4687-b564-2f37ff889d61): created successfully Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc3320c-5af9-4299-8d74-1461b0bef77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (94a097d5-6596-46b4-bcaa-5f90bf4c8e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cb0b7144-ed52-4448-9a8c-939e4142b1e3 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:24 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c 1073741824" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c Sep 28 17:19:24 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-b1aa3079-1867-4dc2-a63a-03642e869c67-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-b1aa3079-1867-4dc2-a63a-03642e869c67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b5859-8c09-4bd2-860f-9258db559d5b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c" returned: 0 in 0.367s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-964094132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b90d30870f840d8b6a76454089677bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='345c6486f0a4419fa185382687447b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Creating volume 8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:24 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 Sep 28 17:19:24 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:24 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d 1073741824 Sep 28 17:19:24 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9496a286-76e2-4d54-b703-ecc3c6f2b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15211333-3591-4822-935c-ffe73ca0401c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63011a5a-2323-41df-80e6-41b874154e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:24 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-15211333-3591-4822-935c-ffe73ca0401c (15211333-3591-4822-935c-ffe73ca0401c): created successfully Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63011a5a-2323-41df-80e6-41b874154e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (30128fbe-c98f-4d4a-a236-9ad8845584df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2e3f72a9-344f-4592-8a42-8c7faa41f2ee tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:25 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67" returned: 0 in 0.493s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:25 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67 Sep 28 17:19:25 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:25 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d 1073741824" returned: 0 in 0.542s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:25 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b1aa3079-1867-4dc2-a63a-03642e869c67" returned: 0 in 0.279s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:25 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-quobyte-b1aa3079-1867-4dc2-a63a-03642e869c67" released by "delete_volume" :: held 0.835s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Created reservations ['bb44d4ca-7270-4fc0-b3b7-04be990a0440', 'a8802924-a96d-4e5a-98f9-6a2b6b276d91', 'e0974c00-166e-4351-8217-dcae98133868', '20db764b-85cd-48ce-ab48-4a3a63fd5d03'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:25 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:25 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:25 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.326s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.165s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-152154624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbd6883-be17-4449-a19b-295cdb9e2f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f499da4a68b4e47a14dadf79bc36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:22Z,use_quota=True,user_id='281df924469243e7b2ce995c2cc0497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Creating volume 0dbd6883-be17-4449-a19b-295cdb9e2f95 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:25 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:25 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 1073741824 Sep 28 17:19:25 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd0b71-224b-4757-9fb6-d7d7a7a70288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd51bf57-f03e-45c2-bbbe-ad898d3546e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Volume volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d (8a1bcf40-62c5-4bb0-93f3-6f2060f5602d): created successfully Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd51bf57-f03e-45c2-bbbe-ad898d3546e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Flow 'volume_create_manager' (37347978-9a73-4c7c-b790-769a8e34c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c4f92001-8ba7-4c3d-a050-d66b9a3c09f0 tempest-VolumesCloneTest-105563507 None] Created volume successfully. Sep 28 17:19:25 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.348s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Deleted volume successfully. Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-699af489-970c-423b-b11c-9d2bdfcb4a0b tempest-SnapshotDependencyTests-95809525 None] Lock "cinder-b1aa3079-1867-4dc2-a63a-03642e869c67-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:26 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 1073741824" returned: 0 in 0.657s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:26 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 Sep 28 17:19:26 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:26 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95" returned: 0 in 0.345s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8d19f0-5ad8-4076-8cfe-3d5f98822209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbd6883-be17-4449-a19b-295cdb9e2f95', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f068b68-108a-47c7-91d5-f590706fd9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Volume volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 (0dbd6883-be17-4449-a19b-295cdb9e2f95): created successfully Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f068b68-108a-47c7-91d5-f590706fd9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Flow 'volume_create_manager' (7020bfd4-964b-4033-8e9e-192690e7fae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Flow 'volume_create_manager' (d1161d04-b9e9-4180-8ff5-0912250a2b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d883bf61-1d7a-41a3-adb4-ee74ee88559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d8fbee1b-54b7-40de-ac61-5fbaa024d306 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created volume successfully. Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d883bf61-1d7a-41a3-adb4-ee74ee88559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-654501327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2f73fe-175d-4965-bb5c-53f4b5fd9028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b90d30870f840d8b6a76454089677bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:27Z,use_quota=True,user_id='345c6486f0a4419fa185382687447b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be292d-6f57-4635-9ef9-fbc8207fafe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be292d-6f57-4635-9ef9-fbc8207fafe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0009d29e-4e95-4a56-bfba-f6681cd4ff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0009d29e-4e95-4a56-bfba-f6681cd4ff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd2f73fe-175d-4965-bb5c-53f4b5fd9028', 'volume_name': 'volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028', 'volume_size': 2, 'source_volid': '8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'source_volstatus': 'available'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e026448f-6d77-4fc5-996f-5df11ce6a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e026448f-6d77-4fc5-996f-5df11ce6a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdae64cd-f674-4be2-ad1d-adec0581fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Volume cd2f73fe-175d-4965-bb5c-53f4b5fd9028: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028', 'volume_size': 2, 'source_volid': '8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'source_volstatus': 'available'} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:27 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Cloning volume 8a1bcf40-62c5-4bb0-93f3-6f2060f5602d to volume cd2f73fe-175d-4965-bb5c-53f4b5fd9028 Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Creating offline snapshot 05f2e77a-65b3-4fff-a9a8-a5de0296c019 of volume 8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75fdc6a-14e7-464c-8ef8-e361451e3f41]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-0dbd6883-be17-4449-a19b-295cdb9e2f95-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-0dbd6883-be17-4449-a19b-295cdb9e2f95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-0dbd6883-be17-4449-a19b-295cdb9e2f95" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-0dbd6883-be17-4449-a19b-295cdb9e2f95" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:27 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:27 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee176b-bd86-4abd-a981-6f030b56811f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:27 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 Sep 28 17:19:27 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:27 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.479s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:27 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 1G Sep 28 17:19:27 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:27 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95" returned: 0 in 0.518s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:27 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95 Sep 28 17:19:27 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:28 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0dbd6883-be17-4449-a19b-295cdb9e2f95" returned: 0 in 0.320s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:28 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-0dbd6883-be17-4449-a19b-295cdb9e2f95" released by "delete_volume" :: held 0.897s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 1G" returned: 0 in 0.586s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:28 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:28 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['9ff25c0e-6bf6-4734-b56d-2bfd3b893a68', '35f86db5-fe51-48e3-b365-d4846a0afe68', '9f4647c3-7e4e-457f-a11f-10f8141d3c36', '4b44a62d-a8bf-451c-9f22-973f7cad7180'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:28 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:28 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-15211333-3591-4822-935c-ffe73ca0401c-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-15211333-3591-4822-935c-ffe73ca0401c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-15211333-3591-4822-935c-ffe73ca0401c" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-15211333-3591-4822-935c-ffe73ca0401c" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5187ad-5f9b-4b45-8730-ce540e3bb2f4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:28 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.489s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:28 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 is being set with open permissions: ugo+rw Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:28 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:28 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:28 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c Sep 28 17:19:28 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:28 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.461s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-df84e6fc-5baf-41a0-824d-5748989c1e58 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-0dbd6883-be17-4449-a19b-295cdb9e2f95-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:29 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.329s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info Sep 28 17:19:29 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:29 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c" returned: 0 in 0.542s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c Sep 28 17:19:29 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:29 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info" returned: 0 in 0.369s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:29 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info is being set with open permissions: ugo+rw Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info Sep 28 17:19:29 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:29 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15211333-3591-4822-935c-ffe73ca0401c" returned: 0 in 0.360s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-15211333-3591-4822-935c-ffe73ca0401c" released by "delete_volume" :: held 0.964s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['efd3d334-7d41-4dc4-81b5-117d017f4ebf', '09c1ef97-0b61-4c6e-a1d4-0590ef156fe4', '0b37abee-a436-4a08-9811-225c82c89a18', '5296a3a1-2211-44bf-96a2-b7e1a0f25b59'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:29 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.info" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:29 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:29 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] snapshot: 05f2e77a-65b3-4fff-a9a8-a5de0296c019, volume: cd2f73fe-175d-4965-bb5c-53f4b5fd9028, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c2294-c0af-41f2-8e4d-19a10e546168]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:30 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-497e7841-5996-4537-b3cd-75ab2495c1a7 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-15211333-3591-4822-935c-ffe73ca0401c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:30 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.438s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a18cdd-131c-473e-bbcf-b7aa5f9aa84a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:30 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-e8e1438c-13e1-4687-b564-2f37ff889d61-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-e8e1438c-13e1-4687-b564-2f37ff889d61-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:30 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-e8e1438c-13e1-4687-b564-2f37ff889d61" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.555s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-e8e1438c-13e1-4687-b564-2f37ff889d61" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:30 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 Sep 28 17:19:30 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ebb897-07ff-429b-8f77-d70223ec760e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:31 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 Sep 28 17:19:31 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:31 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61" returned: 0 in 0.445s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:31 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61 Sep 28 17:19:31 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:31 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e8e1438c-13e1-4687-b564-2f37ff889d61" returned: 0 in 0.456s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-e8e1438c-13e1-4687-b564-2f37ff889d61" released by "delete_volume" :: held 1.036s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['ddd3b8aa-7f0c-46bb-8e3f-8816d958824b', '7263ddff-ae23-46bb-93a0-845c77c319c6', '338cab5f-f0b2-4d1e-bf6d-d845a89cfc04', '1f539ff1-dfaa-426c-9ee6-71380c3f301c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:32 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:32 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:32 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.545s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1714a86d-46ba-48c6-8ad3-775630f92611 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-e8e1438c-13e1-4687-b564-2f37ff889d61-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-6e5c7011-4461-47f2-965d-a302fc200cb2-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-6e5c7011-4461-47f2-965d-a302fc200cb2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-6e5c7011-4461-47f2-965d-a302fc200cb2" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-6e5c7011-4461-47f2-965d-a302fc200cb2" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217b1ee-f86c-4604-80aa-f05f5c078a78]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:33 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 Sep 28 17:19:33 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:34 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2" returned: 0 in 0.710s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:34 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2 Sep 28 17:19:34 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:34 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-6e5c7011-4461-47f2-965d-a302fc200cb2" returned: 0 in 0.609s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-6e5c7011-4461-47f2-965d-a302fc200cb2" released by "delete_volume" :: held 1.433s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['d72f1b03-6831-4f45-9596-b6ebe7f0766f', '1eab7f1e-9cdf-4579-a3ad-62631a178d00', 'f42a1045-4f04-401b-9794-a4d606fe7358', '731ebb16-588f-4830-9e57-49d699ef8caa'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:35 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:35 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.530s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-02a0ec14-d7ed-4a92-955e-221d323e3da2 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-6e5c7011-4461-47f2-965d-a302fc200cb2-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[67426e62-34df-4842-9097-e95c0e960b01]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:36 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 Sep 28 17:19:36 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" returned: 0 in 0.846s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9 Sep 28 17:19:37 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" returned: 0 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9" released by "delete_volume" :: held 1.463s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:37 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['f0d3f70c-f0f5-4619-919e-ce688e5d8f24', '5011a44f-3942-4e18-b1dd-57efdd028b60', '13e2a69a-77f5-4bc5-b033-8700d375a067', 'f3e55b31-5780-4a6c-a69e-e7cb261564ee'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:38 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:38 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-05e47ff7-c576-4dfd-a4f3-e615c5909bc7-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.491s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-05e47ff7-c576-4dfd-a4f3-e615c5909bc7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-54eff7ca-cfba-48d9-bd54-17a9ba2bea05 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-80defc1d-a706-4bd0-a1f9-42f5f5b5dde9-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "cinder-quobyte-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d7016-6049-4d32-ba29-2bd27f4f6565]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 Sep 28 17:19:39 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" returned: 0 in 0.785s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7 Sep 28 17:19:39 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-quobyte-05e47ff7-c576-4dfd-a4f3-e615c5909bc7" released by "delete_volume" :: held 1.332s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Created reservations ['e6b914b9-a5ca-45a7-b04e-4479cd039cd9', '2d943819-c8f5-43e3-97fd-68a0f9dd9845', 'd41527fe-ee6c-45f8-9cf1-2ddbb0f22658', 'b7a279af-2879-4776-a9eb-28ef3fa022f2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:40 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.501s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Deleted volume successfully. Sep 28 17:19:40 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" returned: 0 in 10.084s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:41 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Converted 1024.00 MB image at 101.53 MB/s Sep 28 17:19:41 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 is being set with open permissions: ugo+rw Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-35760ffc-219f-42fa-8be9-3c88e4461648 tempest-CreateVolumesFromSourceVolumeTest-530609413 None] Lock "cinder-05e47ff7-c576-4dfd-a4f3-e615c5909bc7-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:41 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 Sep 28 17:19:41 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:41 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" returned: 0 in 0.400s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" released by "_copy_volume_from_snapshot" :: held 11.594s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-quobyte-05f2e77a-65b3-4fff-a9a8-a5de0296c019" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-05f2e77a-65b3-4fff-a9a8-a5de0296c019" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Deleting offline snapshot 05f2e77a-65b3-4fff-a9a8-a5de0296c019 of volume 8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] snapshot_file for this snap is: volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff6a795-da96-4a04-8e99-f487f5a6e608]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:41 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:41 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:42 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.543s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41f88a-f8b8-438e-8a15-f75845963c15]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:42 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:42 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.812s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:42 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.557s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:43 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019 Sep 28 17:19:43 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d.05f2e77a-65b3-4fff-a9a8-a5de0296c019" returned: 0 in 0.413s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-05f2e77a-65b3-4fff-a9a8-a5de0296c019" released by "_delete_snapshot" :: held 2.486s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.930s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdae64cd-f674-4be2-ad1d-adec0581fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028', 'volume_size': 2, 'source_volid': '8a1bcf40-62c5-4bb0-93f3-6f2060f5602d', 'source_volstatus': 'available'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cad8b4-9ef2-4a4e-a087-f75fefc6431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Volume volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 (cd2f73fe-175d-4965-bb5c-53f4b5fd9028): created successfully Sep 28 17:19:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cad8b4-9ef2-4a4e-a087-f75fefc6431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Flow 'volume_create_manager' (d1161d04-b9e9-4180-8ff5-0912250a2b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-108fe66c-e81b-405f-ac55-2b51281f3116 tempest-VolumesCloneTest-105563507 None] Created volume successfully. Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-cd2f73fe-175d-4965-bb5c-53f4b5fd9028-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "cinder-cd2f73fe-175d-4965-bb5c-53f4b5fd9028-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2f02a-dc4e-4453-9a3e-811eaaf988a8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:45 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 Sep 28 17:19:45 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:46 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:46 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028 Sep 28 17:19:46 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:46 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" returned: 0 in 0.300s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-cd2f73fe-175d-4965-bb5c-53f4b5fd9028" released by "delete_volume" :: held 0.819s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Created reservations ['2ef67e75-a486-41ff-a70c-93449ba82b8b', '10c49d30-c438-4b24-8fbb-b814d096b653', '918c122c-e333-43c3-aa2f-05d516930d95', '1a2cd6f3-987b-47ce-b0d0-a47f6992fe08'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:46 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:46 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "cinder-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Acquiring lock "cinder-quobyte-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:46 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.417s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Deleted volume successfully. Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952843a-cc06-4f9a-84a1-0ae6f86b3a56]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f405e54d-52a7-411a-a35d-c0bc5d218cef tempest-VolumesCloneTest-105563507 None] Lock "cinder-cd2f73fe-175d-4965-bb5c-53f4b5fd9028-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:47 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:47 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:47 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.512s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:47 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d Sep 28 17:19:47 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:47 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" returned: 0 in 0.370s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "cinder-quobyte-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d" released by "delete_volume" :: held 0.982s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Created reservations ['df4a06bf-c185-4a78-873b-ce70dfc78d6a', 'aa5b5574-7a78-4e95-806c-cb1e269b086f', '40fbe80d-63b1-4abb-b737-ee3401cf405c', '8869bdaa-b917-446b-a0e1-6c4068784649'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:48 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:48 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:48 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.323s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Deleted volume successfully. Sep 28 17:19:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a845d74f-cb29-448c-9e8f-8faddfdb21bc tempest-VolumesCloneTest-105563507 None] Lock "cinder-8a1bcf40-62c5-4bb0-93f3-6f2060f5602d-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (ff4698e3-714e-48ed-98df-388ea8941d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30941c01-5246-490e-b832-1b1b206623bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30941c01-5246-490e-b832-1b1b206623bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577778564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac90860-dbe3-4d74-9071-4e1f6d185867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:54Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4743537-dbf7-40e0-ac57-8e1bf121230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4743537-dbf7-40e0-ac57-8e1bf121230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5fb8e-ac6a-4724-b5af-b64e07374a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5fb8e-ac6a-4724-b5af-b64e07374a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac90860-dbe3-4d74-9071-4e1f6d185867', 'volume_name': 'volume-1ac90860-dbe3-4d74-9071-4e1f6d185867', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0975625-8eb9-44ef-8f7b-30346bb30610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0975625-8eb9-44ef-8f7b-30346bb30610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1537a4d-043c-45f2-9315-e5d24f0a56d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Volume 1ac90860-dbe3-4d74-9071-4e1f6d185867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac90860-dbe3-4d74-9071-4e1f6d185867', 'volume_size': 1} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577778564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac90860-dbe3-4d74-9071-4e1f6d185867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:54Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Creating volume 1ac90860-dbe3-4d74-9071-4e1f6d185867 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:53 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:53 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 1073741824 Sep 28 17:19:53 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:54 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 1073741824" returned: 0 in 0.637s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:54 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 Sep 28 17:19:54 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:54 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867" returned: 0 in 0.413s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1537a4d-043c-45f2-9315-e5d24f0a56d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac90860-dbe3-4d74-9071-4e1f6d185867', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7451b31-d7ba-4dc8-bbaa-a4b6a4d3d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Volume volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 (1ac90860-dbe3-4d74-9071-4e1f6d185867): created successfully Sep 28 17:19:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7451b31-d7ba-4dc8-bbaa-a4b6a4d3d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (ff4698e3-714e-48ed-98df-388ea8941d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bec1e2b5-7a52-4bc4-9158-6680f05d02e6 tempest-ProjectReaderTests-1323752466 None] Created volume successfully. Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-1ac90860-dbe3-4d74-9071-4e1f6d185867-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-1ac90860-dbe3-4d74-9071-4e1f6d185867-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-quobyte-1ac90860-dbe3-4d74-9071-4e1f6d185867" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-1ac90860-dbe3-4d74-9071-4e1f6d185867" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[114941ef-3e5c-459c-b2b0-8b1ef710adb9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:56 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 Sep 28 17:19:56 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:56 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867" returned: 0 in 0.505s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:56 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867 Sep 28 17:19:56 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-1ac90860-dbe3-4d74-9071-4e1f6d185867" returned: 0 in 0.359s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-1ac90860-dbe3-4d74-9071-4e1f6d185867" released by "delete_volume" :: held 0.923s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=99,cinder:UPDATE=141,cinder:DELETE=18,cinder:INSERT=29 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Created reservations ['902638dd-ab2a-42ad-941b-02c836807afa', 'b08e041a-9ae4-4f09-bf3c-c520549c891a', '8e0cbba4-5fab-4b81-8640-fa15bd40b1ae', 'f82c62c3-198f-460e-89d0-243268b81c4e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:57 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:19:57 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.332s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Deleted volume successfully. Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-60721cca-a5fb-4085-ab86-2215b50aec31 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-1ac90860-dbe3-4d74-9071-4e1f6d185867-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=156,cinder:INSERT=43,cinder:SELECT=109,cinder:DELETE=8 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (f6b10232-fbe0-4434-912f-2d5b8d7a32dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788f8bb4-939b-471a-a8d7-66639a98f483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788f8bb4-939b-471a-a8d7-66639a98f483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-65995982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09daa962-0cee-491f-8572-ef8941a446aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:58Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3798445-d3e6-4ff7-9a84-45d8beec3e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3798445-d3e6-4ff7-9a84-45d8beec3e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7a9862-3d7f-4e47-bc1c-1ed71f61cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7a9862-3d7f-4e47-bc1c-1ed71f61cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09daa962-0cee-491f-8572-ef8941a446aa', 'volume_name': 'volume-09daa962-0cee-491f-8572-ef8941a446aa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981efc18-4129-4b7b-9f8e-8c7e597b5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981efc18-4129-4b7b-9f8e-8c7e597b5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8bcde3-5eb9-4b51-b00d-722009f79a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Volume 09daa962-0cee-491f-8572-ef8941a446aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09daa962-0cee-491f-8572-ef8941a446aa', 'volume_size': 1} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-65995982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09daa962-0cee-491f-8572-ef8941a446aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:58Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Creating volume 09daa962-0cee-491f-8572-ef8941a446aa {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:58 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:58 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa 1073741824 Sep 28 17:19:58 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:58 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa 1073741824" returned: 0 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:58 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa Sep 28 17:19:58 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8bcde3-5eb9-4b51-b00d-722009f79a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09daa962-0cee-491f-8572-ef8941a446aa', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0092fee-7bb8-4138-a385-b4a470f30249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Volume volume-09daa962-0cee-491f-8572-ef8941a446aa (09daa962-0cee-491f-8572-ef8941a446aa): created successfully Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0092fee-7bb8-4138-a385-b4a470f30249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (f6b10232-fbe0-4434-912f-2d5b8d7a32dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8a4cba8d-dd3e-4904-a081-e72c3989ca17 tempest-VolumesListTestJSON-2095769773 None] Created volume successfully. Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (9f499f73-fae8-470d-86d0-4617ef895429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe93893-e008-455a-b06d-57d3fd567b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe93893-e008-455a-b06d-57d3fd567b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023981642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f431c1-80a3-4bf5-951b-64865a9c291f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:59Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7f264-6552-4bd5-9229-801eef1233dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7f264-6552-4bd5-9229-801eef1233dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9f6765-44ee-4b6e-8033-6ffaaad3d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9f6765-44ee-4b6e-8033-6ffaaad3d99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f431c1-80a3-4bf5-951b-64865a9c291f', 'volume_name': 'volume-75f431c1-80a3-4bf5-951b-64865a9c291f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d75ce5-d471-4a79-91de-0f6a163fa1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d75ce5-d471-4a79-91de-0f6a163fa1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2677b65-e965-4f6e-a2f2-0f9ea6120da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Volume 75f431c1-80a3-4bf5-951b-64865a9c291f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f431c1-80a3-4bf5-951b-64865a9c291f', 'volume_size': 1} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1023981642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f431c1-80a3-4bf5-951b-64865a9c291f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:59Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Creating volume 75f431c1-80a3-4bf5-951b-64865a9c291f {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f 1073741824 Sep 28 17:19:59 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f 1073741824" returned: 0 in 0.498s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f Sep 28 17:19:59 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:00 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f" returned: 0 in 0.291s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2677b65-e965-4f6e-a2f2-0f9ea6120da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f431c1-80a3-4bf5-951b-64865a9c291f', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7679f1-9cfa-4612-9659-f7626295afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Volume volume-75f431c1-80a3-4bf5-951b-64865a9c291f (75f431c1-80a3-4bf5-951b-64865a9c291f): created successfully Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7679f1-9cfa-4612-9659-f7626295afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (9f499f73-fae8-470d-86d0-4617ef895429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-31f9c035-d0d9-41be-99fb-9a879ee614a8 tempest-ProjectReaderTests-1323752466 None] Created volume successfully. Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (defc4ba1-7485-4e24-8dd9-a4875427825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531fcfd9-471f-4dc4-9794-3fce4a8a5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (531fcfd9-471f-4dc4-9794-3fce4a8a5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1878069395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a724a615-e4db-4606-850d-b760cc2c0a98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:01Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e54a43-1b95-4cd4-a8d9-e8735f95c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e54a43-1b95-4cd4-a8d9-e8735f95c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e19726a-3dbd-4a29-865d-5e48254d1dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e19726a-3dbd-4a29-865d-5e48254d1dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a724a615-e4db-4606-850d-b760cc2c0a98', 'volume_name': 'volume-a724a615-e4db-4606-850d-b760cc2c0a98', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20527bdf-9ac0-439f-b32b-f41d29629943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20527bdf-9ac0-439f-b32b-f41d29629943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbae63-4834-48cc-8d25-5a5767edb1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Volume a724a615-e4db-4606-850d-b760cc2c0a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a724a615-e4db-4606-850d-b760cc2c0a98', 'volume_size': 1} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1878069395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a724a615-e4db-4606-850d-b760cc2c0a98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:01Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Creating volume a724a615-e4db-4606-850d-b760cc2c0a98 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:00 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:00 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 1073741824 Sep 28 17:20:00 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 1073741824" returned: 0 in 0.488s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-75f431c1-80a3-4bf5-951b-64865a9c291f-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:01 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-75f431c1-80a3-4bf5-951b-64865a9c291f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-quobyte-75f431c1-80a3-4bf5-951b-64865a9c291f" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-75f431c1-80a3-4bf5-951b-64865a9c291f" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7b496-8c8a-4920-b2f6-a5558fb76057]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f Sep 28 17:20:01 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98" returned: 0 in 0.327s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dbae63-4834-48cc-8d25-5a5767edb1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a724a615-e4db-4606-850d-b760cc2c0a98', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a59ec6d-d312-4799-a6e4-2893656808a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Volume volume-a724a615-e4db-4606-850d-b760cc2c0a98 (a724a615-e4db-4606-850d-b760cc2c0a98): created successfully Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a59ec6d-d312-4799-a6e4-2893656808a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (defc4ba1-7485-4e24-8dd9-a4875427825d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-774e76a1-9b3a-4208-b7b4-c60ebe026471 tempest-VolumesListTestJSON-2095769773 None] Created volume successfully. Sep 28 17:20:01 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f" returned: 0 in 0.421s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f Sep 28 17:20:01 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:02 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-75f431c1-80a3-4bf5-951b-64865a9c291f" returned: 0 in 0.271s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-75f431c1-80a3-4bf5-951b-64865a9c291f" released by "delete_volume" :: held 0.750s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Created reservations ['29802dea-c3dd-4adc-b0b4-5cc0ced672c4', 'f5e4ade4-6f76-4d24-8b24-8bf12247553c', 'ef50ff44-656d-468d-90a1-fa9f1e87f457', '6436a765-867a-42e4-9252-37851917e218'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:02 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:02 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:02 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.256s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Deleted volume successfully. Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f0c51a14-0016-4da5-88cb-d12c809ecc13 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-75f431c1-80a3-4bf5-951b-64865a9c291f-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:02 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:02 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:03 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (c5f98e25-927f-44fb-ab44-7c24acc668c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b383aa-2715-4124-bdb0-31aaf756da07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b383aa-2715-4124-bdb0-31aaf756da07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838377015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ceab15-66b6-4fbe-b369-ed0aaaf02d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ceab15-66b6-4fbe-b369-ed0aaaf02d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04abe0e-faa9-421e-b00a-8f4ffef9eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04abe0e-faa9-421e-b00a-8f4ffef9eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e', 'volume_name': 'volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86aef59-2ea6-45a5-9450-da7625aa3988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86aef59-2ea6-45a5-9450-da7625aa3988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8573a4-7d4e-4fb7-bdcd-7299b47bd6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Volume a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e', 'volume_size': 1} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838377015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Creating volume a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:03 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:03 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e 1073741824 Sep 28 17:20:03 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (225ea128-1c90-4a7f-a0d6-536390ce73e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d707c-7c96-4d4f-be7c-2f1d20a888ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d707c-7c96-4d4f-be7c-2f1d20a888ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1157809154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67a402c-0165-4fe9-85ba-68ee1c2983f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7660b50c-2da6-4e16-9d59-63c3889bdce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7660b50c-2da6-4e16-9d59-63c3889bdce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be959ef6-e562-4e09-a0a9-0bbbc2e93523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be959ef6-e562-4e09-a0a9-0bbbc2e93523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67a402c-0165-4fe9-85ba-68ee1c2983f3', 'volume_name': 'volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d380d2d4-1ab7-4b99-b38e-d39019098d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d380d2d4-1ab7-4b99-b38e-d39019098d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c4067c-cc01-4632-9790-eae7e281655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Volume d67a402c-0165-4fe9-85ba-68ee1c2983f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3', 'volume_size': 1} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e 1073741824" returned: 0 in 0.440s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:03 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e Sep 28 17:20:03 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:03 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" returned: 0 in 0.249s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1157809154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67a402c-0165-4fe9-85ba-68ee1c2983f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb56671422497a80db73840fe12d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='0956b0ff979744619d93bd22c3d60e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Creating volume d67a402c-0165-4fe9-85ba-68ee1c2983f3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:03 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8573a4-7d4e-4fb7-bdcd-7299b47bd6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 1073741824 Sep 28 17:20:03 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eaa62c-f6d9-4bcf-8f54-376fa34fd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:04 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Volume volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e (a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e): created successfully Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45eaa62c-f6d9-4bcf-8f54-376fa34fd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (c5f98e25-927f-44fb-ab44-7c24acc668c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a20a9cf5-10fe-4edc-8928-4fdad5a76478 tempest-ProjectReaderTests-1323752466 None] Created volume successfully. Sep 28 17:20:04 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 1073741824" returned: 0 in 0.513s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:04 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 Sep 28 17:20:04 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:04 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3" returned: 0 in 0.293s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c4067c-cc01-4632-9790-eae7e281655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b44bb1b-59c1-49bb-a221-6b138eb28673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:04 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Volume volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 (d67a402c-0165-4fe9-85ba-68ee1c2983f3): created successfully Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b44bb1b-59c1-49bb-a221-6b138eb28673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Flow 'volume_create_manager' (225ea128-1c90-4a7f-a0d6-536390ce73e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-210f1157-6eda-4e26-987b-f8d24606a253 tempest-VolumesListTestJSON-2095769773 None] Created volume successfully. Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-quobyte-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5423974-4f2f-4389-a00c-b69ee02318f7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:05 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e Sep 28 17:20:05 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:05 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" returned: 0 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:05 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e Sep 28 17:20:05 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:06 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" returned: 0 in 0.289s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e" released by "delete_volume" :: held 0.792s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Created reservations ['c6f615d3-c483-4c89-b763-65784d83ad7b', '4a59c7d9-485e-4f18-8dc8-fbaa1ed53422', 'cfd0d972-62b4-46ea-93b2-0e05f25dfe27', '958fef58-47d1-4abf-9890-8d88c6d8e609'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:06 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:06 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:06 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.322s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Deleted volume successfully. Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3770ae58-1438-4e43-aa5f-33a28d334ae4 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-a7e6b95f-85f9-4a78-ab54-9a7e7fbc2e7e-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:06 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (76e430b7-88f5-4b8d-9081-0f16efb81cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62279ef-00b1-4db3-a162-4267df34402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62279ef-00b1-4db3-a162-4267df34402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369053478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991df42e-6335-4fbe-a0d1-ec1856bc8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:07Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6eb7ec-8e3c-409c-b900-4fe6e734e27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6eb7ec-8e3c-409c-b900-4fe6e734e27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146adbfe-af47-4dea-bdc0-e5d962549daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146adbfe-af47-4dea-bdc0-e5d962549daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991df42e-6335-4fbe-a0d1-ec1856bc8738', 'volume_name': 'volume-991df42e-6335-4fbe-a0d1-ec1856bc8738', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8293e-3102-4850-b88c-53cca5bad0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8293e-3102-4850-b88c-53cca5bad0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465cb07d-67e9-40f8-ad8b-1ab024d8488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:07 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Volume 991df42e-6335-4fbe-a0d1-ec1856bc8738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991df42e-6335-4fbe-a0d1-ec1856bc8738', 'volume_size': 1} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369053478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991df42e-6335-4fbe-a0d1-ec1856bc8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651e59a42b214e84b68ee6d866b381de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:07Z,use_quota=True,user_id='d3439b2855214bc3b27826bde6e84a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Creating volume 991df42e-6335-4fbe-a0d1-ec1856bc8738 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:07 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 1073741824 Sep 28 17:20:07 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:07 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 1073741824" returned: 0 in 0.552s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 Sep 28 17:20:07 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465cb07d-67e9-40f8-ad8b-1ab024d8488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991df42e-6335-4fbe-a0d1-ec1856bc8738', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5a9342-36be-4893-86ae-3d1c350c3949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Volume volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 (991df42e-6335-4fbe-a0d1-ec1856bc8738): created successfully Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5a9342-36be-4893-86ae-3d1c350c3949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Flow 'volume_create_manager' (76e430b7-88f5-4b8d-9081-0f16efb81cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d9f08dbb-1bba-456d-82f2-8abae7b67af4 tempest-ProjectReaderTests-1323752466 None] Created volume successfully. Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-d67a402c-0165-4fe9-85ba-68ee1c2983f3-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-d67a402c-0165-4fe9-85ba-68ee1c2983f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-quobyte-d67a402c-0165-4fe9-85ba-68ee1c2983f3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-d67a402c-0165-4fe9-85ba-68ee1c2983f3" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c1f52-9687-4ac4-beeb-31c8bf096d2d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:08 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 Sep 28 17:20:08 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:08 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3 Sep 28 17:20:08 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-d67a402c-0165-4fe9-85ba-68ee1c2983f3" returned: 0 in 0.319s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-d67a402c-0165-4fe9-85ba-68ee1c2983f3" released by "delete_volume" :: held 0.758s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Created reservations ['ba2aa7ab-0344-49a1-ba14-ba687b24d47b', '266d23c3-c60a-4fa3-8183-0f594f4d35f6', '02d55cfd-e839-4b51-b3d6-a872b64f6072', '53a9393b-8590-4b2f-b4be-a06a78f81ddd'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-991df42e-6335-4fbe-a0d1-ec1856bc8738-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:09 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:09 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-991df42e-6335-4fbe-a0d1-ec1856bc8738-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "cinder-quobyte-991df42e-6335-4fbe-a0d1-ec1856bc8738" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-991df42e-6335-4fbe-a0d1-ec1856bc8738" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[835aef4b-4781-4108-9725-15fe8034709c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-a724a615-e4db-4606-850d-b760cc2c0a98-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-a724a615-e4db-4606-850d-b760cc2c0a98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:09 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 Sep 28 17:20:09 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:09 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.338s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Deleted volume successfully. Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-quobyte-a724a615-e4db-4606-850d-b760cc2c0a98" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9c70f0c3-3e83-4de2-89ee-b29435806f17 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-d67a402c-0165-4fe9-85ba-68ee1c2983f3-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-a724a615-e4db-4606-850d-b760cc2c0a98" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9074a037-d407-43b2-a6fb-97578337895f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 Sep 28 17:20:09 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:09 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738" returned: 0 in 0.481s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738 Sep 28 17:20:09 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:10 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98" returned: 0 in 0.500s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-991df42e-6335-4fbe-a0d1-ec1856bc8738" returned: 0 in 0.291s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-quobyte-991df42e-6335-4fbe-a0d1-ec1856bc8738" released by "delete_volume" :: held 0.833s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:10 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98 Sep 28 17:20:10 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Created reservations ['bdd1c386-8b23-47bb-9bbe-a68fe7794726', '2087e61a-c584-4bb2-a42e-3c323350f139', '68792e3d-165d-4931-b2d4-57be8189af2b', '8d78a3ed-f03b-4176-a30b-8a72bbb3d6a0'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:10 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a724a615-e4db-4606-850d-b760cc2c0a98" returned: 0 in 0.302s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-a724a615-e4db-4606-850d-b760cc2c0a98" released by "delete_volume" :: held 0.852s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Created reservations ['b6a1a9f5-aaad-428e-9bba-fb4789dba732', 'f75fbbd0-bec1-4919-9dcc-b49957e9dfa8', '55a5e278-acf3-4d5b-8beb-0818683bdfbf', '51a4e55c-8bbc-4883-80e6-76e691c6c692'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:10 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.404s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Deleted volume successfully. Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5e6e9ec3-6a62-422e-90d7-aede56c2b594 tempest-ProjectReaderTests-1323752466 None] Lock "cinder-991df42e-6335-4fbe-a0d1-ec1856bc8738-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-09daa962-0cee-491f-8572-ef8941a446aa-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-09daa962-0cee-491f-8572-ef8941a446aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "cinder-quobyte-09daa962-0cee-491f-8572-ef8941a446aa" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-09daa962-0cee-491f-8572-ef8941a446aa" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59c15da-7b7e-4935-abc0-50c894802e46]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.515s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:11 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Deleted volume successfully. Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f097fe34-d561-4e95-aa87-ae82f93f4533 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-a724a615-e4db-4606-850d-b760cc2c0a98-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:11 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa Sep 28 17:20:11 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa" returned: 0 in 0.542s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa Sep 28 17:20:11 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-09daa962-0cee-491f-8572-ef8941a446aa" returned: 0 in 0.328s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-quobyte-09daa962-0cee-491f-8572-ef8941a446aa" released by "delete_volume" :: held 0.940s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:11 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Created reservations ['05576cb5-4e02-47e5-ab18-da040ffcedf4', '40726802-f8f9-42c5-832d-6650c80a0684', 'c38301ab-fe6e-404f-b3bd-097bbb7db356', 'fc6e5e44-e987-4143-8051-0802c915fe71'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:12 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:12 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:12 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Deleted volume successfully. Sep 28 17:20:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c412ab14-44d4-4e91-87d6-8707632c0322 tempest-VolumesListTestJSON-2095769773 None] Lock "cinder-09daa962-0cee-491f-8572-ef8941a446aa-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Flow 'volume_create_manager' (ce478164-9fb7-4878-bb2f-2a4cb01b6e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edf10ac-0f61-4294-97bb-2a0a444f7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9edf10ac-0f61-4294-97bb-2a0a444f7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-406904604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40573832-3352-4a31-874b-012036d12ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c3b83f4128416499ca88911e7f8daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:18Z,use_quota=True,user_id='c2cbd275d86b485ba6fc7ea941c4c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ae54ea-8f8a-4a26-b50d-ac8ec1262c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ae54ea-8f8a-4a26-b50d-ac8ec1262c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7166c083-7473-456d-8015-babaf74b002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7166c083-7473-456d-8015-babaf74b002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40573832-3352-4a31-874b-012036d12ffb', 'volume_name': 'volume-40573832-3352-4a31-874b-012036d12ffb', 'volume_size': 2}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ba0fe-bfcf-4ddd-8478-5a397a28c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293ba0fe-bfcf-4ddd-8478-5a397a28c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594321a-e16d-44d5-8ca9-459a23efa43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Volume 40573832-3352-4a31-874b-012036d12ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40573832-3352-4a31-874b-012036d12ffb', 'volume_size': 2} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-406904604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40573832-3352-4a31-874b-012036d12ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c3b83f4128416499ca88911e7f8daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:18Z,use_quota=True,user_id='c2cbd275d86b485ba6fc7ea941c4c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Creating volume 40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:17 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb 2147483648 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb 2147483648 Sep 28 17:20:17 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:18 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb 2147483648" returned: 0 in 0.539s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:18 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb Sep 28 17:20:18 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:18 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4594321a-e16d-44d5-8ca9-459a23efa43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40573832-3352-4a31-874b-012036d12ffb', 'volume_size': 2}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d6614-4fcd-4aa5-bd8d-9bea36124a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:18 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Volume volume-40573832-3352-4a31-874b-012036d12ffb (40573832-3352-4a31-874b-012036d12ffb): created successfully Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165d6614-4fcd-4aa5-bd8d-9bea36124a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Flow 'volume_create_manager' (ce478164-9fb7-4878-bb2f-2a4cb01b6e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:18 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e294087b-75a8-49f9-b9ed-67d4032573a3 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Created volume successfully. Sep 28 17:20:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Creating offline snapshot b2117872-4166-48e5-a698-e32ce4c8bb22 of volume 40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ebe11-f03b-4a5b-85f6-2a6fcf50e2e1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb Sep 28 17:20:20 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:20 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb" returned: 0 in 0.391s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 2G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 2G Sep 28 17:20:20 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:20 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 2G" returned: 0 in 0.473s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40573832-3352-4a31-874b-012036d12ffb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40573832-3352-4a31-874b-012036d12ffb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 Sep 28 17:20:20 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40573832-3352-4a31-874b-012036d12ffb -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 is being set with open permissions: ugo+rw Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:21 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 Sep 28 17:20:21 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22" returned: 0 in 0.258s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:21 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info Sep 28 17:20:21 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info" returned: 0 in 0.283s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info is being set with open permissions: ugo+rw Sep 28 17:20:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:21 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info Sep 28 17:20:21 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:22 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.info" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ac79efff-017a-4e97-9300-09d9aff33546 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Create snapshot completed successfully Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "cinder-b2117872-4166-48e5-a698-e32ce4c8bb22-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-b2117872-4166-48e5-a698-e32ce4c8bb22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "cinder-quobyte-b2117872-4166-48e5-a698-e32ce4c8bb22" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-b2117872-4166-48e5-a698-e32ce4c8bb22" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Deleting offline snapshot b2117872-4166-48e5-a698-e32ce4c8bb22 of volume 40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] snapshot_file for this snap is: volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6959339c-824f-4551-8472-dabeb60b5329]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:23 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 Sep 28 17:20:23 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:23 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22" returned: 0 in 0.435s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40573832-3352-4a31-874b-012036d12ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a27c3f0-e79c-49ef-8273-b06b9f46de6f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:23 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb Sep 28 17:20:23 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:24 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb" returned: 0 in 0.382s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:24 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 Sep 28 17:20:24 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:24 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22" returned: 0 in 0.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:24 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22 Sep 28 17:20:24 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:24 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb.b2117872-4166-48e5-a698-e32ce4c8bb22" returned: 0 in 0.286s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-b2117872-4166-48e5-a698-e32ce4c8bb22" released by "_delete_snapshot" :: held 1.598s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" released by "delete_snapshot" :: held 1.622s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Created reservations ['ce3f747f-0e8f-4c88-99f2-360d1d4cce33', 'f9bdf7ce-0263-4c2f-9f39-04eb19a0a4c3', '93618e82-6953-403d-a6cf-0a53d4bfcb27', '26582f9e-4959-495a-9d52-0fafd60a5f52'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Delete snapshot completed successfully. Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-31c17668-7fc0-47c6-95ad-3ebc612de989 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-b2117872-4166-48e5-a698-e32ce4c8bb22-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "cinder-40573832-3352-4a31-874b-012036d12ffb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-40573832-3352-4a31-874b-012036d12ffb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c42cebd-b626-4ec0-8f29-6f5291043ad3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:25 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb Sep 28 17:20:25 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb" returned: 0 in 0.398s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:26 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb Sep 28 17:20:26 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-40573832-3352-4a31-874b-012036d12ffb" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-quobyte-40573832-3352-4a31-874b-012036d12ffb" released by "delete_volume" :: held 0.739s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Created reservations ['eca61d08-e8ae-45b5-b9fb-2e7918268c0b', 'e4acc711-488f-468b-9b06-550334f0ac9c', 'c2e66c62-3578-4be7-9acb-9eae33c315c3', 'd8451c50-1fc6-4464-b6a5-5e47a7b352cb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:26 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:20:26 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.313s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Deleted volume successfully. Sep 28 17:20:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ecaf5d5a-52d8-429a-8b44-cfa02d32a379 tempest-VolumesSnapshotNegativeTestJSON-236249728 None] Lock "cinder-40573832-3352-4a31-874b-012036d12ffb-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:36 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=92,cinder:SELECT=63,cinder:DELETE=12,cinder:INSERT=16 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:36 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=56,cinder:UPDATE=83,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:53 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Flow 'volume_create_manager' (a6a6c539-09ee-4a30-9147-1fd427f825e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34fcfaf-c70d-4cef-b283-6a661bd297ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34fcfaf-c70d-4cef-b283-6a661bd297ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-370082683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968ce3330d2b4fccb4df4beb1dfd3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='134e9623a78847df8acdfff57bc56b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0af2774-5ed3-473b-928e-0897f5949280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0af2774-5ed3-473b-928e-0897f5949280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26aca4-290d-4209-a7c4-6fead85e7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f26aca4-290d-4209-a7c4-6fead85e7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c', 'volume_name': 'volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4d8194-b609-4ad1-92a5-1d11b16a3544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4d8194-b609-4ad1-92a5-1d11b16a3544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b0fc5-852e-4558-aa2b-9b33c32cfaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c', 'volume_size': 1} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-370082683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968ce3330d2b4fccb4df4beb1dfd3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='134e9623a78847df8acdfff57bc56b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Creating volume ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:54 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c 1073741824 Sep 28 17:20:54 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Flow 'volume_create_manager' (7989eeda-8d5a-486a-90dd-5d28edec116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8e87a-45b8-4902-9538-2c47b989e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8e87a-45b8-4902-9538-2c47b989e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1258250276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1947305-5483-4dd2-b5e7-9826407678db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968ce3330d2b4fccb4df4beb1dfd3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='134e9623a78847df8acdfff57bc56b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd653df-b7b3-42ee-96fa-5cf17cfc0d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd653df-b7b3-42ee-96fa-5cf17cfc0d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea63370-9107-4708-a0cd-cf116fed3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea63370-9107-4708-a0cd-cf116fed3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1947305-5483-4dd2-b5e7-9826407678db', 'volume_name': 'volume-f1947305-5483-4dd2-b5e7-9826407678db', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50d9187-fb6b-4f1d-9f44-f2f6c420086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50d9187-fb6b-4f1d-9f44-f2f6c420086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2253dc8-52d8-455c-b168-15a4111d652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume f1947305-5483-4dd2-b5e7-9826407678db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1947305-5483-4dd2-b5e7-9826407678db', 'volume_size': 1} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c 1073741824" returned: 0 in 0.587s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c Sep 28 17:20:54 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" returned: 0 in 0.349s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1258250276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1947305-5483-4dd2-b5e7-9826407678db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968ce3330d2b4fccb4df4beb1dfd3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='134e9623a78847df8acdfff57bc56b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Creating volume f1947305-5483-4dd2-b5e7-9826407678db {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:55 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81b0fc5-852e-4558-aa2b-9b33c32cfaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693f28b4-e9b6-4fbf-a020-a9496b52fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db 1073741824 Sep 28 17:20:55 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c (ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c): created successfully Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693f28b4-e9b6-4fbf-a020-a9496b52fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Flow 'volume_create_manager' (a6a6c539-09ee-4a30-9147-1fd427f825e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e6b6bfef-7145-4c87-807a-c7e79f990e6e tempest-TestServerVolumeAttachmentScenario-441761438 None] Created volume successfully. Sep 28 17:20:55 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db 1073741824" returned: 0 in 0.611s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db Sep 28 17:20:55 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db" returned: 0 in 0.353s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2253dc8-52d8-455c-b168-15a4111d652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1947305-5483-4dd2-b5e7-9826407678db', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb2654-dc69-4ac1-8b6a-eee98effa39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Volume volume-f1947305-5483-4dd2-b5e7-9826407678db (f1947305-5483-4dd2-b5e7-9826407678db): created successfully Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fb2654-dc69-4ac1-8b6a-eee98effa39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Flow 'volume_create_manager' (7989eeda-8d5a-486a-90dd-5d28edec116e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:56 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-42999fd0-3a00-4b71-b6ac-5ed2998b5733 tempest-TestServerVolumeAttachmentScenario-441761438 None] Created volume successfully. Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:02 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:21:02 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:03 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.419s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:06 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:06 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-12e3ae26-96ca-49f2-a57b-6636fb77469f req-70919cf9-cb9d-42cd-807d-4ef4bf234555 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-12e3ae26-96ca-49f2-a57b-6636fb77469f req-70919cf9-cb9d-42cd-807d-4ef4bf234555 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-12e3ae26-96ca-49f2-a57b-6636fb77469f req-70919cf9-cb9d-42cd-807d-4ef4bf234555 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-12e3ae26-96ca-49f2-a57b-6636fb77469f req-70919cf9-cb9d-42cd-807d-4ef4bf234555 tempest-TestServerVolumeAttachmentScenario-441761438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe7590ec-a88e-420e-843f-e0d67ed0ceac', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-12e3ae26-96ca-49f2-a57b-6636fb77469f req-70919cf9-cb9d-42cd-807d-4ef4bf234555 tempest-TestServerVolumeAttachmentScenario-441761438 None] attachment_update completed successfully. Sep 28 17:21:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5da40fbf-0574-44d3-89d6-4d61717ec29f req-afea74a5-7eb8-412d-9c76-85a0dcedfbdd tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5da40fbf-0574-44d3-89d6-4d61717ec29f req-afea74a5-7eb8-412d-9c76-85a0dcedfbdd tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-5da40fbf-0574-44d3-89d6-4d61717ec29f req-afea74a5-7eb8-412d-9c76-85a0dcedfbdd tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-5da40fbf-0574-44d3-89d6-4d61717ec29f req-afea74a5-7eb8-412d-9c76-85a0dcedfbdd tempest-TestServerVolumeAttachmentScenario-441761438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-f1947305-5483-4dd2-b5e7-9826407678db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cbcdfc7-ff16-4059-8097-3b79234edaee', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-5da40fbf-0574-44d3-89d6-4d61717ec29f req-afea74a5-7eb8-412d-9c76-85a0dcedfbdd tempest-TestServerVolumeAttachmentScenario-441761438 None] attachment_update completed successfully. Sep 28 17:21:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-779c00d8-fb6d-47aa-9dc8-5cf62239fce7 req-856f4846-dbd7-45f6-9471-caa0ec2a0d10 tempest-TestServerVolumeAttachmentScenario-441761438 None] Terminate volume connection completed successfully. Sep 28 17:21:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-779c00d8-fb6d-47aa-9dc8-5cf62239fce7 req-856f4846-dbd7-45f6-9471-caa0ec2a0d10 tempest-TestServerVolumeAttachmentScenario-441761438 None] Deleting attachment 0cbcdfc7-ff16-4059-8097-3b79234edaee. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-afa21669-48f9-4995-9399-ed24626b459e req-77a2a0c6-d1a2-4f66-99b5-045769498e50 tempest-TestServerVolumeAttachmentScenario-441761438 None] Terminate volume connection completed successfully. Sep 28 17:21:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-afa21669-48f9-4995-9399-ed24626b459e req-77a2a0c6-d1a2-4f66-99b5-045769498e50 tempest-TestServerVolumeAttachmentScenario-441761438 None] Deleting attachment fe7590ec-a88e-420e-843f-e0d67ed0ceac. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "cinder-f1947305-5483-4dd2-b5e7-9826407678db-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-f1947305-5483-4dd2-b5e7-9826407678db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "cinder-quobyte-f1947305-5483-4dd2-b5e7-9826407678db" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-quobyte-f1947305-5483-4dd2-b5e7-9826407678db" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e09be8-6ca7-4a37-a469-792b5fcd65f9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db Sep 28 17:21:40 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db" returned: 0 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db Sep 28 17:21:41 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f1947305-5483-4dd2-b5e7-9826407678db" returned: 0 in 0.258s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-quobyte-f1947305-5483-4dd2-b5e7-9826407678db" released by "delete_volume" :: held 0.701s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Created reservations ['ed04f7b0-e7d0-4251-ba45-e3940a766c1d', '964cda10-43ab-432f-a9c7-bff6b8fb2a81', '320d3c34-ba1d-4bcd-8d24-424362f3994f', 'd4a752f2-a26a-46ba-9ae9-ccd6a6836975'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:21:41 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "cinder-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:41 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Deleted volume successfully. Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ce1dae02-94b8-46c2-b020-2fa4f071cdc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-f1947305-5483-4dd2-b5e7-9826407678db-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "cinder-quobyte-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-quobyte-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8deff68-439d-4be9-aa97-8c49bcf14182]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c Sep 28 17:21:42 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" returned: 0 in 0.393s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c Sep 28 17:21:42 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-quobyte-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c" released by "delete_volume" :: held 0.714s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Created reservations ['cd8ed28d-5df8-4ff0-af7c-c33b0f03c168', 'ccdc4050-fa24-4842-9048-4fa59edb8660', '9737e088-36db-4309-a61b-ab6875cd0f4f', '67b81765-0b25-477e-a227-f99f48228bf7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:21:42 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.293s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Deleted volume successfully. Sep 28 17:21:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c73a312d-3dfb-4db8-afd0-f2ebacd5dcc5 tempest-TestServerVolumeAttachmentScenario-441761438 None] Lock "cinder-ee4ee23a-2ea0-40dd-a950-f1d3c2ccf19c-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:52 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:53 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:22:02 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.336s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Flow 'volume_create_manager' (65da9f0f-6006-4ee7-99ee-c6ff92af7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07f2d25-92e0-4584-9ee3-4e3f4a751810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07f2d25-92e0-4584-9ee3-4e3f4a751810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1668254882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48987609-b4cc-4e7e-b76f-3592fa6a70ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09181f57d2de400ca10f3dbb75ae058b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:21Z,use_quota=True,user_id='f7c5e572d65d415ea925f880b1e84d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebba7101-0b24-42e0-a767-f279bb5d43e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebba7101-0b24-42e0-a767-f279bb5d43e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0edd7-4b0e-4b82-a965-6a8cd8e6f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f0edd7-4b0e-4b82-a965-6a8cd8e6f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48987609-b4cc-4e7e-b76f-3592fa6a70ff', 'volume_name': 'volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce658c82-39b2-4049-a7b1-23fb44f0e35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce658c82-39b2-4049-a7b1-23fb44f0e35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03840fa5-3599-492c-8357-380385704da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Volume 48987609-b4cc-4e7e-b76f-3592fa6a70ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff', 'volume_size': 1} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1668254882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48987609-b4cc-4e7e-b76f-3592fa6a70ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09181f57d2de400ca10f3dbb75ae058b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:21Z,use_quota=True,user_id='f7c5e572d65d415ea925f880b1e84d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Creating volume 48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff 1073741824 Sep 28 17:22:21 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff 1073741824" returned: 0 in 0.476s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:21 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:22 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03840fa5-3599-492c-8357-380385704da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b4d9e-7118-4647-93f2-b90664f412f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Volume volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff (48987609-b4cc-4e7e-b76f-3592fa6a70ff): created successfully Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16b4d9e-7118-4647-93f2-b90664f412f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Flow 'volume_create_manager' (65da9f0f-6006-4ee7-99ee-c6ff92af7b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-066cc046-3cdf-424d-8fbf-d47d6186c7cb tempest-TestImageHashVerification-1816580554 None] Created volume successfully. Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[640da15a-b19f-469f-9f7a-0a7450696a0f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:24 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:24 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:24 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb862b1-2dff-4b99-b392-9512406600d2]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:24 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:24 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:25 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.433s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff /opt/stack/data/cinder/conversion/48987609-b4cc-4e7e-b76f-3592fa6a70ff.temp_image.5ba73cd3-dff0-48ec-becb-926bb3c70352kt1wpgim.img {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:25 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff /opt/stack/data/cinder/conversion/48987609-b4cc-4e7e-b76f-3592fa6a70ff.temp_image.5ba73cd3-dff0-48ec-becb-926bb3c70352kt1wpgim.img Sep 28 17:22:25 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:31 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff /opt/stack/data/cinder/conversion/48987609-b4cc-4e7e-b76f-3592fa6a70ff.temp_image.5ba73cd3-dff0-48ec-becb-926bb3c70352kt1wpgim.img" returned: 0 in 6.137s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[da032216-fbff-4e0c-8661-f7c0ca7f1eb1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:31 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:31 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:32 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.642s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:32 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/48987609-b4cc-4e7e-b76f-3592fa6a70ff.temp_image.5ba73cd3-dff0-48ec-becb-926bb3c70352kt1wpgim.img {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:32 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Converted 1024.00 MB image at 166.82 MB/s Sep 28 17:22:32 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] 5ba73cd3-dff0-48ec-becb-926bb3c70352 was raw, no need to convert to raw {{(pid=87034) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:22:34 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:42 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.090s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:53 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Uploaded volume to glance image-id: 5ba73cd3-dff0-48ec-becb-926bb3c70352. {{(pid=87034) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:22:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-33e5dc5f-4465-49eb-b80e-169194b883f2 tempest-TestImageHashVerification-1816580554 None] Copy volume to image completed successfully. Sep 28 17:22:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Acquiring lock "cinder-48987609-b4cc-4e7e-b76f-3592fa6a70ff-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "cinder-48987609-b4cc-4e7e-b76f-3592fa6a70ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Acquiring lock "cinder-quobyte-48987609-b4cc-4e7e-b76f-3592fa6a70ff" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "cinder-quobyte-48987609-b4cc-4e7e-b76f-3592fa6a70ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe07d61-f799-4074-9d6b-2fb497276a20]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:54 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.355s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff Sep 28 17:22:54 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-48987609-b4cc-4e7e-b76f-3592fa6a70ff" returned: 0 in 0.254s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "cinder-quobyte-48987609-b4cc-4e7e-b76f-3592fa6a70ff" released by "delete_volume" :: held 0.651s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Created reservations ['cfd40755-96e7-4751-a914-61609e6ef0d4', 'fb64fa1b-ada4-4616-8cb4-9339fd881726', 'c2020fb0-f66b-4e85-96c7-a70ecadab5cf', '28f273f1-941d-47a0-a961-1818f1136f20'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:22:54 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Deleted volume successfully. Sep 28 17:22:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-834ed1cf-b191-4661-aacf-9847a6ae0f52 tempest-TestImageHashVerification-1816580554 None] Lock "cinder-48987609-b4cc-4e7e-b76f-3592fa6a70ff-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:02 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:23:02 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:03 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.383s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:04 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=12,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:05 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Flow 'volume_create_manager' (fc5cfac7-7ba2-4121-be2a-289fc3f503b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69913d8a-ca5b-4687-8957-12ae2247e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69913d8a-ca5b-4687-8957-12ae2247e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-619941319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15de42aa-db3d-4779-a2e4-b8e1ee889764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d5e8b3f76d40d4b5c7d3d45235421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:34Z,use_quota=True,user_id='61f96b46cdff415fb62dde89c3675aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450a073a-1e3a-49ce-a41b-ba2384d7f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450a073a-1e3a-49ce-a41b-ba2384d7f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce68e7e6-5f3c-4476-8009-b76cf7a9be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce68e7e6-5f3c-4476-8009-b76cf7a9be24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15de42aa-db3d-4779-a2e4-b8e1ee889764', 'volume_name': 'volume-15de42aa-db3d-4779-a2e4-b8e1ee889764', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345227fe-e650-4a37-9e34-222bcdde9c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345227fe-e650-4a37-9e34-222bcdde9c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569169a8-34b5-496f-8e57-e5f3c0c50533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Volume 15de42aa-db3d-4779-a2e4-b8e1ee889764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15de42aa-db3d-4779-a2e4-b8e1ee889764', 'volume_size': 1} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-619941319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15de42aa-db3d-4779-a2e4-b8e1ee889764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d5e8b3f76d40d4b5c7d3d45235421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:34Z,use_quota=True,user_id='61f96b46cdff415fb62dde89c3675aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Creating volume 15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:23:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 1073741824 Sep 28 17:23:34 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 1073741824" returned: 0 in 0.489s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:23:35 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.302s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569169a8-34b5-496f-8e57-e5f3c0c50533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15de42aa-db3d-4779-a2e4-b8e1ee889764', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215530a-8e9f-44ae-a0e2-20e33f271469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Volume volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 (15de42aa-db3d-4779-a2e4-b8e1ee889764): created successfully Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215530a-8e9f-44ae-a0e2-20e33f271469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Flow 'volume_create_manager' (fc5cfac7-7ba2-4121-be2a-289fc3f503b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d713e4b5-4ca9-4eb5-9605-34dad0b6e2b0 tempest-TestStampPattern-2028439848 None] Created volume successfully. Sep 28 17:23:45 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:45 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:02 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:24:02 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:03 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.304s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee02c8e1-b916-4442-acd9-1ee2644bab00 req-1d2439de-ed03-4a01-93bb-42a15f6f12a2 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee02c8e1-b916-4442-acd9-1ee2644bab00 req-1d2439de-ed03-4a01-93bb-42a15f6f12a2 tempest-TestStampPattern-2028439848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-ee02c8e1-b916-4442-acd9-1ee2644bab00 req-1d2439de-ed03-4a01-93bb-42a15f6f12a2 tempest-TestStampPattern-2028439848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-ee02c8e1-b916-4442-acd9-1ee2644bab00 req-1d2439de-ed03-4a01-93bb-42a15f6f12a2 tempest-TestStampPattern-2028439848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-15de42aa-db3d-4779-a2e4-b8e1ee889764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a94afeb5-e3e3-4ee3-bec9-96ba476d5f67', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:24:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-ee02c8e1-b916-4442-acd9-1ee2644bab00 req-1d2439de-ed03-4a01-93bb-42a15f6f12a2 tempest-TestStampPattern-2028439848 None] attachment_update completed successfully. Sep 28 17:24:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-ce395192-b8ed-402e-aab2-8930aea78410 req-f18ad340-e7d8-49d3-be76-01906a55e4d9 tempest-TestStampPattern-2028439848 None] Terminate volume connection completed successfully. Sep 28 17:24:12 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-ce395192-b8ed-402e-aab2-8930aea78410 req-f18ad340-e7d8-49d3-be76-01906a55e4d9 tempest-TestStampPattern-2028439848 None] Deleting attachment a94afeb5-e3e3-4ee3-bec9-96ba476d5f67. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Creating offline snapshot 13a6f61d-2afb-45b9-a728-f479f2e40896 of volume 15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f999a7-bd8d-476e-b9b5-1b6e01f5d7cb]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:13 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:24:13 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:13 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.391s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:13 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 1G Sep 28 17:24:13 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 1G" returned: 0 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:24:14 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.338s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 is being set with open permissions: ugo+rw Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:24:14 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.301s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info Sep 28 17:24:14 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info is being set with open permissions: ugo+rw Sep 28 17:24:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info Sep 28 17:24:15 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.info" returned: 0 in 0.291s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dc5150b9-15a0-4a91-befc-1f795e1b365e tempest-TestStampPattern-2028439848 None] Create snapshot completed successfully Sep 28 17:24:24 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:24 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Flow 'volume_create_manager' (e6113a7d-5ee5-4cf1-99ad-96fc8007868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f153632-ecf2-4c25-be1d-1d0786f8ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f153632-ecf2-4c25-be1d-1d0786f8ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1371139036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff9da19-5a8e-4333-b27b-a67d3feed192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d5e8b3f76d40d4b5c7d3d45235421c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13a6f61d-2afb-45b9-a728-f479f2e40896,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:25Z,use_quota=True,user_id='61f96b46cdff415fb62dde89c3675aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240aec8-89d1-4dcf-88c6-e4f671ef3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240aec8-89d1-4dcf-88c6-e4f671ef3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b53f69f-b6b0-4384-b094-d843ed41a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b53f69f-b6b0-4384-b094-d843ed41a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ff9da19-5a8e-4333-b27b-a67d3feed192', 'volume_name': 'volume-3ff9da19-5a8e-4333-b27b-a67d3feed192', 'volume_size': 1, 'snapshot_id': '13a6f61d-2afb-45b9-a728-f479f2e40896'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fb0652-4099-4d7f-902c-7c34bf193625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fb0652-4099-4d7f-902c-7c34bf193625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d5ae1-344a-4d54-942d-8f9e099ed37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:25 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Volume 3ff9da19-5a8e-4333-b27b-a67d3feed192: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ff9da19-5a8e-4333-b27b-a67d3feed192', 'volume_size': 1, 'snapshot_id': '13a6f61d-2afb-45b9-a728-f479f2e40896'} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896-3ff9da19-5a8e-4333-b27b-a67d3feed192" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896-3ff9da19-5a8e-4333-b27b-a67d3feed192" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Creating volume 3ff9da19-5a8e-4333-b27b-a67d3feed192 from snapshot 13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] snapshot: 13a6f61d-2afb-45b9-a728-f479f2e40896, volume: 3ff9da19-5a8e-4333-b27b-a67d3feed192, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba20adb-0319-43a9-8d7c-6a2319083773]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:25 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:24:25 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:25 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.465s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15de42aa-db3d-4779-a2e4-b8e1ee889764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa29536-205f-40b1-9a5e-b0c3c88a932a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:25 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:24:25 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:26 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.474s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:24:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:24:26 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:24:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:26 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 Sep 28 17:24:26 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:35 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192" returned: 0 in 9.518s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764, size 1024.00 MB, duration 9.52 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:35 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Converted 1024.00 MB image at 107.57 MB/s Sep 28 17:24:35 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 is being set with open permissions: ugo+rw Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 Sep 28 17:24:35 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192" returned: 0 in 0.301s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" released by "_copy_volume_from_snapshot" :: held 10.885s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896-3ff9da19-5a8e-4333-b27b-a67d3feed192" released by "_create_volume_from_snapshot" :: held 10.962s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.982s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d5ae1-344a-4d54-942d-8f9e099ed37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff9da19-5a8e-4333-b27b-a67d3feed192', 'volume_size': 1, 'snapshot_id': '13a6f61d-2afb-45b9-a728-f479f2e40896'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23327978-6e2d-4b03-8086-6340da66e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Volume volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 (3ff9da19-5a8e-4333-b27b-a67d3feed192): created successfully Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23327978-6e2d-4b03-8086-6340da66e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Flow 'volume_create_manager' (e6113a7d-5ee5-4cf1-99ad-96fc8007868c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b56fd67c-fcff-40e3-b248-40b416a107bb tempest-TestStampPattern-2028439848 None] Created volume successfully. Sep 28 17:24:46 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:46 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:02 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:02 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1a6b85ac-3456-4c55-8b56-a2131d24860e req-6cadf6de-e231-4101-b1b2-6de6a41fa2c5 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1a6b85ac-3456-4c55-8b56-a2131d24860e req-6cadf6de-e231-4101-b1b2-6de6a41fa2c5 tempest-TestStampPattern-2028439848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [req-1a6b85ac-3456-4c55-8b56-a2131d24860e req-6cadf6de-e231-4101-b1b2-6de6a41fa2c5 tempest-TestStampPattern-2028439848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:04 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-1a6b85ac-3456-4c55-8b56-a2131d24860e req-6cadf6de-e231-4101-b1b2-6de6a41fa2c5 tempest-TestStampPattern-2028439848 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d', 'name': 'volume-3ff9da19-5a8e-4333-b27b-a67d3feed192', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a31aa45-ee86-4b2d-8a0e-750d3f2e8314', 'enforce_multipath': True} {{(pid=87034) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:25:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-1a6b85ac-3456-4c55-8b56-a2131d24860e req-6cadf6de-e231-4101-b1b2-6de6a41fa2c5 tempest-TestStampPattern-2028439848 None] attachment_update completed successfully. Sep 28 17:25:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [req-d5ec8892-ca7f-479f-8702-0e47c41c81e4 req-1f5d0a4c-dce4-4ebe-a9aa-e208dda54549 tempest-TestStampPattern-2028439848 None] Terminate volume connection completed successfully. Sep 28 17:25:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [req-d5ec8892-ca7f-479f-8702-0e47c41c81e4 req-1f5d0a4c-dce4-4ebe-a9aa-e208dda54549 tempest-TestStampPattern-2028439848 None] Deleting attachment 4a31aa45-ee86-4b2d-8a0e-750d3f2e8314. {{(pid=87034) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-3ff9da19-5a8e-4333-b27b-a67d3feed192-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "cinder-3ff9da19-5a8e-4333-b27b-a67d3feed192-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b07aba-0454-4951-af56-21dd1a28e4b8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:12 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 Sep 28 17:25:12 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:12 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192" returned: 0 in 0.376s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:12 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192 Sep 28 17:25:12 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:13 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ff9da19-5a8e-4333-b27b-a67d3feed192" returned: 0 in 0.266s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-3ff9da19-5a8e-4333-b27b-a67d3feed192" released by "delete_volume" :: held 0.688s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Created reservations ['a38db357-acab-431b-8fdf-5fd471d0345c', '2a696da1-772c-42c6-bdbb-abd8b289a16e', '31f57b91-6656-4327-a89f-98431dd7120b', '2fe2acbf-297b-4c56-9270-7ea2ef7086e2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:13 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:13 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:13 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.302s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Deleted volume successfully. Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-10730be2-29a5-448d-ae1f-910ce77e9507 tempest-TestStampPattern-2028439848 None] Lock "cinder-3ff9da19-5a8e-4333-b27b-a67d3feed192-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-13a6f61d-2afb-45b9-a728-f479f2e40896-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-13a6f61d-2afb-45b9-a728-f479f2e40896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Deleting offline snapshot 13a6f61d-2afb-45b9-a728-f479f2e40896 of volume 15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] snapshot_file for this snap is: volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15cb3a0-1fc9-48f7-b713-c17a0fe96560]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:14 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:25:14 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:14 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15de42aa-db3d-4779-a2e4-b8e1ee889764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1105fe4-f575-442b-82b9-c228ebd03259]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:14 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:25:14 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:15 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.649s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:15 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:25:15 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:15 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:15 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896 Sep 28 17:25:15 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:15 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764.13a6f61d-2afb-45b9-a728-f479f2e40896" returned: 0 in 0.236s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-13a6f61d-2afb-45b9-a728-f479f2e40896" released by "_delete_snapshot" :: held 1.777s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" released by "delete_snapshot" :: held 1.800s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Created reservations ['132d7be5-2624-4372-9317-f3e1f15b060c', 'd5a2d28f-37c5-439c-a491-8cbd98c0ba0e', 'ba48581e-25ba-4a38-a6e6-7b519b5e4381', 'e5f5890b-15ee-4a69-83e1-723e8242ef7b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:15 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Delete snapshot completed successfully. Sep 28 17:25:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-15899502-26f5-40b8-adb2-b5662846f8e0 tempest-TestStampPattern-2028439848 None] Lock "cinder-13a6f61d-2afb-45b9-a728-f479f2e40896-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-15de42aa-db3d-4779-a2e4-b8e1ee889764-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "cinder-15de42aa-db3d-4779-a2e4-b8e1ee889764-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Acquiring lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32f0db-6ea7-4e46-99c1-ce0f26940146]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:19 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:25:19 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764 Sep 28 17:25:20 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-15de42aa-db3d-4779-a2e4-b8e1ee889764" returned: 0 in 0.238s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "cinder-quobyte-15de42aa-db3d-4779-a2e4-b8e1ee889764" released by "delete_volume" :: held 0.668s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Created reservations ['ed266518-a5de-48b7-865b-b03aee3bff29', '56280084-ac0c-4b34-bb24-a67e71d50e55', 'ea8d285f-8537-49f8-ad9c-2a763aa02772', '38b2a471-29ba-4dd1-b9cc-f8dd06a0676e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:20 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.254s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:20 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Deleted volume successfully. Sep 28 17:25:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b575c0e6-09df-47a5-b02a-c58f2ee9b174 tempest-TestStampPattern-2028439848 None] Lock "cinder-15de42aa-db3d-4779-a2e4-b8e1ee889764-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:30 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:30 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (01cb25e5-7535-4ab5-9929-5a7964709a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4fd4f-ff6d-4572-bb3f-52a7d73faa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4fd4f-ff6d-4572-bb3f-52a7d73faa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778339847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eaa2c3-6ccf-4f5d-b46c-807ab4628394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:34Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20a816f-bbea-4975-9db2-984d59ff6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20a816f-bbea-4975-9db2-984d59ff6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc75c503-3b74-4411-b9bd-6064e324b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc75c503-3b74-4411-b9bd-6064e324b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2eaa2c3-6ccf-4f5d-b46c-807ab4628394', 'volume_name': 'volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efffab2-acbe-47ad-86e9-68f8320176c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efffab2-acbe-47ad-86e9-68f8320176c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4aa682-1916-43e7-9e42-2a698f957a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume a2eaa2c3-6ccf-4f5d-b46c-807ab4628394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394', 'volume_size': 1} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778339847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eaa2c3-6ccf-4f5d-b46c-807ab4628394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:34Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Creating volume a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:34 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 1073741824 Sep 28 17:25:34 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (2d11f50b-b5c8-41d0-8dbb-25f78b9ec3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d909d1f-d459-4312-bf09-2b9bcefe2679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d909d1f-d459-4312-bf09-2b9bcefe2679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502070917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba54733-bab3-41d2-9270-3c995e6a271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:35Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abb3f47-34a0-49df-ae7e-556c54b31b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abb3f47-34a0-49df-ae7e-556c54b31b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00577f8-78f7-4664-863a-d7de926fe7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00577f8-78f7-4664-863a-d7de926fe7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba54733-bab3-41d2-9270-3c995e6a271a', 'volume_name': 'volume-7ba54733-bab3-41d2-9270-3c995e6a271a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62eac12-70dc-49b6-8bb1-583fb164874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62eac12-70dc-49b6-8bb1-583fb164874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35d2bc1-6b00-4a2c-9a22-675c5a15a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Volume 7ba54733-bab3-41d2-9270-3c995e6a271a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba54733-bab3-41d2-9270-3c995e6a271a', 'volume_size': 1} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 1073741824" returned: 0 in 0.547s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:35 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 Sep 28 17:25:35 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (64bbc90c-f719-4655-aa3b-5757ae5f947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ffc10-04a9-4ef5-b9df-311454df95a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1ffc10-04a9-4ef5-b9df-311454df95a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1130092599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d86ef9-dd88-4a78-b7f1-4933f6bc074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:35Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a4dbd-36c4-4385-9ae3-ec020753c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391a4dbd-36c4-4385-9ae3-ec020753c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ee980c-6f9c-46fb-aafd-2e1e62e6ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ee980c-6f9c-46fb-aafd-2e1e62e6ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d86ef9-dd88-4a78-b7f1-4933f6bc074b', 'volume_name': 'volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aaa802-e323-4d56-a49a-e30223ec57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aaa802-e323-4d56-a49a-e30223ec57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3718d872-a902-411b-b002-1a5ca3303fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Volume c4d86ef9-dd88-4a78-b7f1-4933f6bc074b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b', 'volume_size': 1} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1502070917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba54733-bab3-41d2-9270-3c995e6a271a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:35Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Creating volume 7ba54733-bab3-41d2-9270-3c995e6a271a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:35 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4aa682-1916-43e7-9e42-2a698f957a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a 1073741824 Sep 28 17:25:35 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c8acb9-0fd5-4572-82e8-1f9d503be8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 (a2eaa2c3-6ccf-4f5d-b46c-807ab4628394): created successfully Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c8acb9-0fd5-4572-82e8-1f9d503be8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (01cb25e5-7535-4ab5-9929-5a7964709a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7fe3cf3a-2c81-4871-ba01-e1c5fbbc04c5 tempest-CreateVolumesFromImageTest-2024258147 None] Created volume successfully. Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (47adefa6-dece-4f8a-9524-8031c85dbf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd73564f-d998-45e5-9521-b509952390e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd73564f-d998-45e5-9521-b509952390e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88672102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794477fa-330e-4456-b4ec-bd558c07b07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:36Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e961c4-4eea-4285-94f3-7e34070f18a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e961c4-4eea-4285-94f3-7e34070f18a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1d7da-1651-49cb-a2cf-0dbd3c909cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f1d7da-1651-49cb-a2cf-0dbd3c909cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794477fa-330e-4456-b4ec-bd558c07b07a', 'volume_name': 'volume-794477fa-330e-4456-b4ec-bd558c07b07a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45396ad7-c31b-487d-9638-68fbfd87fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45396ad7-c31b-487d-9638-68fbfd87fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc790de2-0f71-4d53-9962-ad1e736d19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume 794477fa-330e-4456-b4ec-bd558c07b07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794477fa-330e-4456-b4ec-bd558c07b07a', 'volume_size': 1} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:36 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a 1073741824" returned: 0 in 0.631s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a Sep 28 17:25:36 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (b743a925-ff1a-4148-865c-b2ddb24ac471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d8c62c-8b53-47c4-af94-e3ae1e818b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d8c62c-8b53-47c4-af94-e3ae1e818b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627319745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b268c012-3d72-4277-97bf-377d13994bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:36Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66ba615-72e1-4449-9b4f-0bc9d897aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66ba615-72e1-4449-9b4f-0bc9d897aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc883ad-dd66-4208-a760-d95fcb222a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc883ad-dd66-4208-a760-d95fcb222a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b268c012-3d72-4277-97bf-377d13994bf5', 'volume_name': 'volume-b268c012-3d72-4277-97bf-377d13994bf5', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8801c2e7-c920-469a-8056-f5d6fa24d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8801c2e7-c920-469a-8056-f5d6fa24d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3996aea-9c55-4dad-acfe-554d4a15ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Volume b268c012-3d72-4277-97bf-377d13994bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b268c012-3d72-4277-97bf-377d13994bf5', 'volume_size': 1} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:36 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a" returned: 0 in 0.258s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1130092599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d86ef9-dd88-4a78-b7f1-4933f6bc074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:35Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Creating volume c4d86ef9-dd88-4a78-b7f1-4933f6bc074b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:36 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b 1073741824 Sep 28 17:25:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35d2bc1-6b00-4a2c-9a22-675c5a15a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba54733-bab3-41d2-9270-3c995e6a271a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab4aaa-1785-4d2a-99cd-da765827d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Volume volume-7ba54733-bab3-41d2-9270-3c995e6a271a (7ba54733-bab3-41d2-9270-3c995e6a271a): created successfully Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ab4aaa-1785-4d2a-99cd-da765827d6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (2d11f50b-b5c8-41d0-8dbb-25f78b9ec3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-74ded4e7-7c05-4227-b81c-6b25b0ed92f7 tempest-CreateVolumesFromImageTest-2024258147 None] Created volume successfully. Sep 28 17:25:37 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b 1073741824" returned: 0 in 0.431s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:37 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b Sep 28 17:25:37 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:37 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" returned: 0 in 0.272s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88672102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794477fa-330e-4456-b4ec-bd558c07b07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:36Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Creating volume 794477fa-330e-4456-b4ec-bd558c07b07a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:37 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3718d872-a902-411b-b002-1a5ca3303fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82250d0a-3fdf-4a64-a4b2-019b5f8b14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:37 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a 1073741824 Sep 28 17:25:37 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:37 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Volume volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b (c4d86ef9-dd88-4a78-b7f1-4933f6bc074b): created successfully Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82250d0a-3fdf-4a64-a4b2-019b5f8b14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (64bbc90c-f719-4655-aa3b-5757ae5f947e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4520d03c-4a58-4fd2-925b-063b3aa743be tempest-CreateVolumesFromImageTest-2024258147 None] Created volume successfully. Sep 28 17:25:37 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a 1073741824" returned: 0 in 0.500s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:37 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a Sep 28 17:25:37 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a" returned: 0 in 0.266s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1627319745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b268c012-3d72-4277-97bf-377d13994bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e1b1b4c5054864a31fb423035956cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:36Z,use_quota=True,user_id='1ce0a9f6abed49fc8ea43060eafc6b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Creating volume b268c012-3d72-4277-97bf-377d13994bf5 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc790de2-0f71-4d53-9962-ad1e736d19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794477fa-330e-4456-b4ec-bd558c07b07a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:38 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 1073741824 Sep 28 17:25:38 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8e8b73-d55a-444c-af0f-866c8f2545bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Volume volume-794477fa-330e-4456-b4ec-bd558c07b07a (794477fa-330e-4456-b4ec-bd558c07b07a): created successfully Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8e8b73-d55a-444c-af0f-866c8f2545bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (47adefa6-dece-4f8a-9524-8031c85dbf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3061c85d-af85-4a40-bed7-fa4e40a59ab5 tempest-CreateVolumesFromImageTest-2024258147 None] Created volume successfully. Sep 28 17:25:38 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 1073741824" returned: 0 in 0.450s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:38 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 Sep 28 17:25:38 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5" returned: 0 in 0.285s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3996aea-9c55-4dad-acfe-554d4a15ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b268c012-3d72-4277-97bf-377d13994bf5', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0faeb-9903-4ee2-81d9-40f2a94e505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Volume volume-b268c012-3d72-4277-97bf-377d13994bf5 (b268c012-3d72-4277-97bf-377d13994bf5): created successfully Sep 28 17:25:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0faeb-9903-4ee2-81d9-40f2a94e505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Flow 'volume_create_manager' (b743a925-ff1a-4148-865c-b2ddb24ac471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1662a262-87e6-4dd6-96c7-00ee5af3befe tempest-CreateVolumesFromImageTest-2024258147 None] Created volume successfully. Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-b268c012-3d72-4277-97bf-377d13994bf5-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-b268c012-3d72-4277-97bf-377d13994bf5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-quobyte-b268c012-3d72-4277-97bf-377d13994bf5" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-b268c012-3d72-4277-97bf-377d13994bf5" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579b7b0-d42d-432a-8486-35d7c698ec5b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:40 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 Sep 28 17:25:40 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:40 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5" returned: 0 in 0.374s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:40 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5 Sep 28 17:25:40 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:40 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b268c012-3d72-4277-97bf-377d13994bf5" returned: 0 in 0.246s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-b268c012-3d72-4277-97bf-377d13994bf5" released by "delete_volume" :: held 0.664s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Created reservations ['a90df5ec-06fe-4fd9-a25a-0d346ad29358', '17a1a750-f234-4c5d-9622-67fb39da4c82', '400af6d8-4e6b-480e-b975-77796fba17c9', '041f3f2b-561e-4e02-bcd5-3e35ab5a310b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:40 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:40 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:41 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-794477fa-330e-4456-b4ec-bd558c07b07a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.346s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Deleted volume successfully. Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-794477fa-330e-4456-b4ec-bd558c07b07a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-cc6be89f-85f8-4356-8764-ed655a5bc64f tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-b268c012-3d72-4277-97bf-377d13994bf5-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-quobyte-794477fa-330e-4456-b4ec-bd558c07b07a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-794477fa-330e-4456-b4ec-bd558c07b07a" acquired by "delete_volume" :: waited 0.013s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d998f0f8-9ef5-4733-87f9-5a0a6d0a8252]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:41 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a Sep 28 17:25:41 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:41 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a" returned: 0 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:41 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a Sep 28 17:25:41 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:41 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-794477fa-330e-4456-b4ec-bd558c07b07a" returned: 0 in 0.249s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-794477fa-330e-4456-b4ec-bd558c07b07a" released by "delete_volume" :: held 0.685s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Created reservations ['bb869035-77ad-4fb5-9a19-85298bba8ae7', '325a2497-60be-4592-8313-fde10a716c39', '17f86fa2-dd62-44d8-8d2d-25ff16f269d6', 'be00d960-a4eb-482e-84ac-9efc7ec84f59'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:42 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:42 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.257s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Deleted volume successfully. Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4d230363-fed5-4b8e-8af6-de2a71b5a473 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-794477fa-330e-4456-b4ec-bd558c07b07a-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-quobyte-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d2dbd7-63ed-4760-b4ac-6e39ecc24b53]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:42 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b Sep 28 17:25:42 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" returned: 0 in 0.402s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:42 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b Sep 28 17:25:42 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b" released by "delete_volume" :: held 0.732s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Created reservations ['334fba86-6af1-49dc-9be1-df4173cf9f03', 'e8ae0746-2804-438c-82ac-3a8a41250b23', '95d2b5c3-5d59-4c19-a4cc-ec792d686b13', 'e9591d2b-1046-4e3d-a491-483c6152a3b9'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:43 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-7ba54733-bab3-41d2-9270-3c995e6a271a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-7ba54733-bab3-41d2-9270-3c995e6a271a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-quobyte-7ba54733-bab3-41d2-9270-3c995e6a271a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.324s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Deleted volume successfully. Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-7ba54733-bab3-41d2-9270-3c995e6a271a" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b5714445-4f9f-43ea-bb4a-99d45546f00d tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-c4d86ef9-dd88-4a78-b7f1-4933f6bc074b-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ae77a-28f7-48ab-88a5-dae5aba92d82]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a Sep 28 17:25:43 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a" returned: 0 in 0.424s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a Sep 28 17:25:44 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7ba54733-bab3-41d2-9270-3c995e6a271a" returned: 0 in 0.262s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-7ba54733-bab3-41d2-9270-3c995e6a271a" released by "delete_volume" :: held 0.740s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Created reservations ['41c386f3-fb25-49b2-b0c1-0bd9c7b9c2bf', '3e2c0a03-27a9-4601-8bc4-26462e6e44bd', '19226637-4eb7-4285-991c-9fe7e5b6a32f', 'c71b241e-9b46-4290-8f1e-2ba9c8d2e11f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:44 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "cinder-quobyte-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:44 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.340s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Deleted volume successfully. Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5606273-5ff3-423a-a6af-d15e2a678929]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e98582a6-0da8-45de-ac2b-f000fbc77081 tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-7ba54733-bab3-41d2-9270-3c995e6a271a-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:44 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 Sep 28 17:25:44 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394 Sep 28 17:25:45 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" returned: 0 in 0.312s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-quobyte-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394" released by "delete_volume" :: held 0.762s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Created reservations ['acab0387-e158-407f-9fcf-0727d8beaea7', '93f7a7f0-b7ee-4bad-939b-30e47d1c69f2', '29c7f1e3-c471-4bad-a877-be2c584ed673', '601f8e18-41ab-43ca-abfd-57d648bc7e01'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:25:45 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Deleted volume successfully. Sep 28 17:25:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f1dfbee5-9705-494b-a111-dd19cba231cd tempest-CreateVolumesFromImageTest-2024258147 None] Lock "cinder-a2eaa2c3-6ccf-4f5d-b46c-807ab4628394-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Flow 'volume_create_manager' (55614008-1b50-48a6-85ca-ce4b2db6a667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d39a86-b1ce-40f8-91d8-577205006e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d39a86-b1ce-40f8-91d8-577205006e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-560335530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2a006a-09a9-4203-ab0a-907180b3884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f37580a1641dc81adf2dd97861bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:49Z,use_quota=True,user_id='c9380898eb93402c801a68fc16e4eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feee13a3-26da-47dc-8082-a711d22e1fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feee13a3-26da-47dc-8082-a711d22e1fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41650857-5c8c-488a-8348-63a5098a2954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41650857-5c8c-488a-8348-63a5098a2954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2a006a-09a9-4203-ab0a-907180b3884b', 'volume_name': 'volume-9c2a006a-09a9-4203-ab0a-907180b3884b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c6fe0-8aa5-452d-9c4b-c294e879be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670c6fe0-8aa5-452d-9c4b-c294e879be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994c7de1-4905-4a05-aa8e-642fda7ad83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Volume 9c2a006a-09a9-4203-ab0a-907180b3884b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2a006a-09a9-4203-ab0a-907180b3884b', 'volume_size': 1} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-560335530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2a006a-09a9-4203-ab0a-907180b3884b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f37580a1641dc81adf2dd97861bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:49Z,use_quota=True,user_id='c9380898eb93402c801a68fc16e4eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Creating volume 9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:49 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:49 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b 1073741824 Sep 28 17:25:49 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:49 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b 1073741824" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:49 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:25:49 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:49 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.273s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994c7de1-4905-4a05-aa8e-642fda7ad83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2a006a-09a9-4203-ab0a-907180b3884b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5572e4-40ba-46bf-b460-9fa9da7866e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Volume volume-9c2a006a-09a9-4203-ab0a-907180b3884b (9c2a006a-09a9-4203-ab0a-907180b3884b): created successfully Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5572e4-40ba-46bf-b460-9fa9da7866e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Flow 'volume_create_manager' (55614008-1b50-48a6-85ca-ce4b2db6a667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f624d4a1-3c8a-4674-89c3-9c85ca731e63 tempest-VolumeDependencyTests-553170502 None] Created volume successfully. Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Creating offline snapshot 9001a10b-9007-4ca6-bd5e-5ac2a786f0de of volume 9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6f26c0-3cfe-4afd-b0c8-52bf19711c8b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:50 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:25:50 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:50 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:50 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de 1G Sep 28 17:25:50 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:51 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de 1G" returned: 0 in 0.459s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2a006a-09a9-4203-ab0a-907180b3884b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:51 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2a006a-09a9-4203-ab0a-907180b3884b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:25:51 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:51 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2a006a-09a9-4203-ab0a-907180b3884b -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.359s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:51 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de is being set with open permissions: ugo+rw Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:51 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:25:51 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:51 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.261s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:51 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info Sep 28 17:25:51 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:52 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:52 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info is being set with open permissions: ugo+rw Sep 28 17:25:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:52 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info Sep 28 17:25:52 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:52 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.info" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f4b7a09d-a2fb-49a3-8685-389d7b026579 tempest-VolumeDependencyTests-553170502 None] Create snapshot completed successfully Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Flow 'volume_create_manager' (ff32205d-2688-48da-beb6-1dff8591354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6328b77-d084-4207-8c9a-beb8cab6091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6328b77-d084-4207-8c9a-beb8cab6091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515942355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636f37b7-5fd8-49fe-ac05-d3aff0759607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12f37580a1641dc81adf2dd97861bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9001a10b-9007-4ca6-bd5e-5ac2a786f0de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:54Z,use_quota=True,user_id='c9380898eb93402c801a68fc16e4eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ebfc27-db33-4358-b375-c89ecf4ea533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ebfc27-db33-4358-b375-c89ecf4ea533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0d896b-1fd6-4b36-916a-f60b13b97aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0d896b-1fd6-4b36-916a-f60b13b97aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '636f37b7-5fd8-49fe-ac05-d3aff0759607', 'volume_name': 'volume-636f37b7-5fd8-49fe-ac05-d3aff0759607', 'volume_size': 1, 'snapshot_id': '9001a10b-9007-4ca6-bd5e-5ac2a786f0de'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e3b4fa-a743-40cc-9da4-c7718522986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e3b4fa-a743-40cc-9da4-c7718522986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1f5226-75c7-4a76-812b-9b1b74d0a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Volume 636f37b7-5fd8-49fe-ac05-d3aff0759607: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-636f37b7-5fd8-49fe-ac05-d3aff0759607', 'volume_size': 1, 'snapshot_id': '9001a10b-9007-4ca6-bd5e-5ac2a786f0de'} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-636f37b7-5fd8-49fe-ac05-d3aff0759607" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-636f37b7-5fd8-49fe-ac05-d3aff0759607" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Creating volume 636f37b7-5fd8-49fe-ac05-d3aff0759607 from snapshot 9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] snapshot: 9001a10b-9007-4ca6-bd5e-5ac2a786f0de, volume: 636f37b7-5fd8-49fe-ac05-d3aff0759607, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a10520-25bb-46cc-b6f3-35c514021baf]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:25:54 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.424s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2a006a-09a9-4203-ab0a-907180b3884b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e76c4f-4755-42eb-acc4-bd8764c1b5f0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:25:54 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:55 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.431s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:55 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:55 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 Sep 28 17:25:55 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607" returned: 0 in 6.547s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:01 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Converted 1024.00 MB image at 156.37 MB/s Sep 28 17:26:01 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 is being set with open permissions: ugo+rw Sep 28 17:26:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 Sep 28 17:26:01 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607" returned: 0 in 0.265s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" released by "_copy_volume_from_snapshot" :: held 7.761s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-636f37b7-5fd8-49fe-ac05-d3aff0759607" released by "_create_volume_from_snapshot" :: held 7.846s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.863s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1f5226-75c7-4a76-812b-9b1b74d0a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636f37b7-5fd8-49fe-ac05-d3aff0759607', 'volume_size': 1, 'snapshot_id': '9001a10b-9007-4ca6-bd5e-5ac2a786f0de'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cc46fc-a9b9-4348-9fb9-40e51896e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Volume volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 (636f37b7-5fd8-49fe-ac05-d3aff0759607): created successfully Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cc46fc-a9b9-4348-9fb9-40e51896e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Flow 'volume_create_manager' (ff32205d-2688-48da-beb6-1dff8591354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8a8e43e3-1e2c-4983-99d2-874ffb779428 tempest-VolumeDependencyTests-553170502 None] Created volume successfully. Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:02 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Deleting offline snapshot 9001a10b-9007-4ca6-bd5e-5ac2a786f0de of volume 9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:02 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] snapshot_file for this snap is: volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.319s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d5c114-3294-4cd6-9c4d-1df59d075e60]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:26:03 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.400s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2a006a-09a9-4203-ab0a-907180b3884b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[be98fc78-f514-4526-816c-656a7c9baa21]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:26:03 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.604s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:26:04 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.352s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de Sep 28 17:26:04 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b.9001a10b-9007-4ca6-bd5e-5ac2a786f0de" returned: 0 in 0.283s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9001a10b-9007-4ca6-bd5e-5ac2a786f0de" released by "_delete_snapshot" :: held 1.830s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" released by "delete_snapshot" :: held 1.859s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Created reservations ['a6058540-7f1e-4914-bf22-c1c109aa5bfa', '630559a5-31b2-4a77-93d2-e4ef61e2e470', '308d302e-a579-47b0-b0ca-d217a2db1ed5', '0f0db6ca-fc3d-45fc-814f-7c2e0b42f134'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Delete snapshot completed successfully. Sep 28 17:26:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7ea80bfe-f66f-4ecb-93a8-05a7af1a189b tempest-VolumeDependencyTests-553170502 None] Lock "cinder-9001a10b-9007-4ca6-bd5e-5ac2a786f0de-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-9c2a006a-09a9-4203-ab0a-907180b3884b-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-9c2a006a-09a9-4203-ab0a-907180b3884b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f9f9e-a817-49b5-af4c-26012fd1655b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:26:05 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b Sep 28 17:26:05 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9c2a006a-09a9-4203-ab0a-907180b3884b" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-9c2a006a-09a9-4203-ab0a-907180b3884b" released by "delete_volume" :: held 0.756s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:05 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Created reservations ['786a13d4-fa78-44d0-b5b2-108f6d86bc03', '3d96be38-466c-49a1-aad5-76affdf81f86', 'e7bc3baa-a2dc-4b16-8cdd-6754ffac79e4', '0615c84e-a47c-4a95-b2cf-5321563d1fc4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:06 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-636f37b7-5fd8-49fe-ac05-d3aff0759607-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "cinder-636f37b7-5fd8-49fe-ac05-d3aff0759607-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:06 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Acquiring lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Deleted volume successfully. Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5269bb02-e710-423a-afca-1b8492c77291 tempest-VolumeDependencyTests-553170502 None] Lock "cinder-9c2a006a-09a9-4203-ab0a-907180b3884b-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c80a6c-85a6-4b8c-99c7-6506ac2881de]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 Sep 28 17:26:06 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607" returned: 0 in 0.419s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607 Sep 28 17:26:06 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-636f37b7-5fd8-49fe-ac05-d3aff0759607" returned: 0 in 0.285s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "cinder-quobyte-636f37b7-5fd8-49fe-ac05-d3aff0759607" released by "delete_volume" :: held 0.765s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Created reservations ['2fc97efe-3b8b-48bd-a2c6-93f8c82b95e3', '09d2bf95-0244-4acb-a10c-f639334aa09c', 'b83d96ef-24d5-4e35-8106-a3a8fa19974c', '35d6f15d-ff53-4afe-842e-1530e6716c92'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:07 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:07 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Deleted volume successfully. Sep 28 17:26:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a9094a2b-e10f-4fb9-873e-ea794ecb07cd tempest-VolumeDependencyTests-553170502 None] Lock "cinder-636f37b7-5fd8-49fe-ac05-d3aff0759607-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:17 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=86,cinder:SELECT=51,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:17 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=68,cinder:UPDATE=82,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (8260f243-776c-4b13-88ab-6da247695544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931ef94e-f747-438e-b94e-23ce90b89dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931ef94e-f747-438e-b94e-23ce90b89dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311249189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9080e9e1-49f5-4cab-9baf-b58eed74b8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:26Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a77dd4f-09f2-472e-a2ca-9d47a30c6b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a77dd4f-09f2-472e-a2ca-9d47a30c6b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5426eedf-8429-4dea-ae8d-55da79153362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5426eedf-8429-4dea-ae8d-55da79153362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9080e9e1-49f5-4cab-9baf-b58eed74b8a7', 'volume_name': 'volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00413b24-2440-4b81-9b1a-69fa335550d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00413b24-2440-4b81-9b1a-69fa335550d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc102f5-7090-400b-a6ec-0c1fdbe0a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Volume 9080e9e1-49f5-4cab-9baf-b58eed74b8a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7', 'volume_size': 1} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311249189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9080e9e1-49f5-4cab-9baf-b58eed74b8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:26Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Creating volume 9080e9e1-49f5-4cab-9baf-b58eed74b8a7 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:26 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 1073741824 Sep 28 17:26:26 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (dea2b09d-ac8f-45e1-8d7a-4f2770511198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce69dbd-edc9-49bd-89f1-26a60e0229e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce69dbd-edc9-49bd-89f1-26a60e0229e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990023654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a3ac96-c5ad-4f4b-ade4-029c706b95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa8f105-b280-4808-a03a-f3a290215363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa8f105-b280-4808-a03a-f3a290215363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2f8407-b0fb-4ed2-bad9-d7861cbc2f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2f8407-b0fb-4ed2-bad9-d7861cbc2f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a3ac96-c5ad-4f4b-ade4-029c706b95dc', 'volume_name': 'volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c78748-4c67-4e9e-83e0-f56a8f6311ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c78748-4c67-4e9e-83e0-f56a8f6311ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605a5220-4fb1-47c4-8207-366bbfc76cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume 00a3ac96-c5ad-4f4b-ade4-029c706b95dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc', 'volume_size': 1} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (00937315-7b50-47c5-906a-acea3675a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d4687-8631-4be9-9ec5-3eb7e27fc6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d4687-8631-4be9-9ec5-3eb7e27fc6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1056449518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eea01d-4a31-4972-bdf9-cc99929bb179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d611ee-431e-436c-8e2e-df11f3cc6c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d611ee-431e-436c-8e2e-df11f3cc6c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bf1989-0a98-41f8-b927-c3248d2d3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bf1989-0a98-41f8-b927-c3248d2d3267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16eea01d-4a31-4972-bdf9-cc99929bb179', 'volume_name': 'volume-16eea01d-4a31-4972-bdf9-cc99929bb179', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12627d46-2d8f-4a3a-ba29-da71a3a92e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12627d46-2d8f-4a3a-ba29-da71a3a92e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf0d7eb-0fda-4cf9-a4d1-d7e9ff13392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Volume 16eea01d-4a31-4972-bdf9-cc99929bb179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16eea01d-4a31-4972-bdf9-cc99929bb179', 'volume_size': 1} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 1073741824" returned: 0 in 0.827s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:27 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 Sep 28 17:26:27 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (bafd6549-2b1c-4ebb-80cd-4fc3aee4ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824c0251-fa09-44b6-a9de-af92d97989e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824c0251-fa09-44b6-a9de-af92d97989e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529606895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccd0d72-5bdb-4933-bc54-62d574603998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a597d81-8c45-4966-bc6b-4188f8f5a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a597d81-8c45-4966-bc6b-4188f8f5a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba86f9f-3ec4-4c2b-9977-4c5e71d118ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba86f9f-3ec4-4c2b-9977-4c5e71d118ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cccd0d72-5bdb-4933-bc54-62d574603998', 'volume_name': 'volume-cccd0d72-5bdb-4933-bc54-62d574603998', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746333b5-be3a-498e-ad4e-35d1c39db887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746333b5-be3a-498e-ad4e-35d1c39db887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa505edb-14fa-4692-9ada-35a6b44160c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Volume cccd0d72-5bdb-4933-bc54-62d574603998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cccd0d72-5bdb-4933-bc54-62d574603998', 'volume_size': 1} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" returned: 0 in 0.353s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-990023654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a3ac96-c5ad-4f4b-ade4-029c706b95dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume 00a3ac96-c5ad-4f4b-ade4-029c706b95dc {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:27 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc102f5-7090-400b-a6ec-0c1fdbe0a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b54607d-366e-4a18-9922-b3055bdfbe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc 1073741824 Sep 28 17:26:27 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Volume volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 (9080e9e1-49f5-4cab-9baf-b58eed74b8a7): created successfully Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b54607d-366e-4a18-9922-b3055bdfbe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (8260f243-776c-4b13-88ab-6da247695544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-443c96d6-19ff-4676-a027-db6ea821052e tempest-CreateVolumesFromImageTest-1031841267 None] Created volume successfully. Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (3a0507af-f53c-427a-bd60-76ceba4bb51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7bd898-6bde-49fd-9c88-fca8a6d590d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7bd898-6bde-49fd-9c88-fca8a6d590d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938373323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695cab6c-3573-405e-89ce-169dc6217e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:28Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb79a855-cbc0-4175-997c-766a35d37c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb79a855-cbc0-4175-997c-766a35d37c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16678f4-89f4-4924-96c5-cb4017e803da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16678f4-89f4-4924-96c5-cb4017e803da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695cab6c-3573-405e-89ce-169dc6217e66', 'volume_name': 'volume-695cab6c-3573-405e-89ce-169dc6217e66', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416592eb-d668-43f2-a71f-7c141bd62119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416592eb-d668-43f2-a71f-7c141bd62119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278e965-bce4-4a3c-873c-c6efbc29ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Volume 695cab6c-3573-405e-89ce-169dc6217e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695cab6c-3573-405e-89ce-169dc6217e66', 'volume_size': 1} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:28 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc 1073741824" returned: 0 in 0.638s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc Sep 28 17:26:28 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (14186a3b-1964-4cd1-aed2-b2e7bcdfa967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a618537-4d6e-4a63-80e8-d64b2ea1fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a618537-4d6e-4a63-80e8-d64b2ea1fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322224186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6f795e-453a-4e5a-932b-b7455aac9c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:29Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57183057-7509-43ae-9ee1-90c64d3adc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57183057-7509-43ae-9ee1-90c64d3adc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43bf0b7-15d5-40df-b9b2-a19280f966f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43bf0b7-15d5-40df-b9b2-a19280f966f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6f795e-453a-4e5a-932b-b7455aac9c68', 'volume_name': 'volume-fc6f795e-453a-4e5a-932b-b7455aac9c68', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1c4320-4be5-4c1b-ac60-572314cf2a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1c4320-4be5-4c1b-ac60-572314cf2a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab4d948-5503-4c0e-b382-69f9bf66f332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:28 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Volume fc6f795e-453a-4e5a-932b-b7455aac9c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6f795e-453a-4e5a-932b-b7455aac9c68', 'volume_size': 1} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:28 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1056449518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eea01d-4a31-4972-bdf9-cc99929bb179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Creating volume 16eea01d-4a31-4972-bdf9-cc99929bb179 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:28 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605a5220-4fb1-47c4-8207-366bbfc76cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:28 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 1073741824 Sep 28 17:26:28 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cad1db1-95f9-40fe-91cb-e85432a6b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:29 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc (00a3ac96-c5ad-4f4b-ade4-029c706b95dc): created successfully Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cad1db1-95f9-40fe-91cb-e85432a6b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (dea2b09d-ac8f-45e1-8d7a-4f2770511198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:29 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cbc8dc3e-0217-404c-aa5f-d34024404c89 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:29 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 1073741824" returned: 0 in 0.514s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 Sep 28 17:26:29 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179" returned: 0 in 0.337s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.187s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529606895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccd0d72-5bdb-4933-bc54-62d574603998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:27Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Creating volume cccd0d72-5bdb-4933-bc54-62d574603998 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:29 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf0d7eb-0fda-4cf9-a4d1-d7e9ff13392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16eea01d-4a31-4972-bdf9-cc99929bb179', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:29 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 1073741824 Sep 28 17:26:29 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf74a715-0df8-4c75-b025-02aef5a8ec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:29 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Volume volume-16eea01d-4a31-4972-bdf9-cc99929bb179 (16eea01d-4a31-4972-bdf9-cc99929bb179): created successfully Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf74a715-0df8-4c75-b025-02aef5a8ec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:29 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (00937315-7b50-47c5-906a-acea3675a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-49232c51-4916-4f13-a2ca-cbcf779e1254 tempest-CreateVolumesFromImageTest-1031841267 None] Created volume successfully. Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Flow 'volume_create_manager' (acd708d8-3595-4a12-af0b-88ea5dcbad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee37962-4487-4498-b735-191cfa09b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee37962-4487-4498-b735-191cfa09b700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae9dc28-9aeb-419d-b539-5643f91faffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1cbe48ddb443dba301fb5be5d098b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='b854fd58b19047feb6b2eed34d7c5740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b28a480-91e8-40af-9ac7-bc57ab8a61a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b28a480-91e8-40af-9ac7-bc57ab8a61a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5036750-dfde-4753-804a-11aeada5ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (7a121ba3-6ddc-484f-9db8-ef4ed5dcaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e569d87-223f-4c84-8029-5a6fb0846ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 1073741824" returned: 0 in 0.904s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e569d87-223f-4c84-8029-5a6fb0846ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91205178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9260e27-2bf4-40c3-aaf5-9e3fb1ce2d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9260e27-2bf4-40c3-aaf5-9e3fb1ce2d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9232fc-2f0f-4e82-b104-4b6a9ddcd5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff9232fc-2f0f-4e82-b104-4b6a9ddcd5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf', 'volume_name': 'volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888c0847-cf07-4847-9857-3bc55bb41945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888c0847-cf07-4847-9857-3bc55bb41945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2778adb6-079c-4904-a40b-6d77acd5a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf', 'volume_size': 1} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:30 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 Sep 28 17:26:30 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5036750-dfde-4753-804a-11aeada5ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ae9dc28-9aeb-419d-b539-5643f91faffd', 'volume_name': 'volume-3ae9dc28-9aeb-419d-b539-5643f91faffd', 'volume_size': 1, 'image_id': '7db7e647-b915-48a0-9248-0539526d8076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2de63fe843a608e8ebfdfccd6a14767', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cbe48ddb443dba301fb5be5d098b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86cbef70c7de6d872e0e035167264eeb578354bf30a9c1ed801fe65250a8275f1c7a7e29534d771893cc262ef4cacb43cfb1bf90634a9dedfd6bd782c752d021', 'id': '7db7e647-b915-48a0-9248-0539526d8076', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db7e647-b915-48a0-9248-0539526d8076/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6516c0-92fe-49ea-8a16-1692c65e01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6516c0-92fe-49ea-8a16-1692c65e01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1cd0e5-3ccd-43f3-b7e4-4cfd1d7ce968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Volume 3ae9dc28-9aeb-419d-b539-5643f91faffd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ae9dc28-9aeb-419d-b539-5643f91faffd', 'volume_size': 1, 'image_id': '7db7e647-b915-48a0-9248-0539526d8076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2de63fe843a608e8ebfdfccd6a14767', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cbe48ddb443dba301fb5be5d098b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86cbef70c7de6d872e0e035167264eeb578354bf30a9c1ed801fe65250a8275f1c7a7e29534d771893cc262ef4cacb43cfb1bf90634a9dedfd6bd782c752d021', 'id': '7db7e647-b915-48a0-9248-0539526d8076', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db7e647-b915-48a0-9248-0539526d8076/file', 'properties': {}}, 'image_service': } Sep 28 17:26:30 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Trying to clone 3ae9dc28-9aeb-419d-b539-5643f91faffd from image 7db7e647-b915-48a0-9248-0539526d8076 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:26:31 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c454c8-cd12-4990-a3e9-a54620e441b5]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-938373323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695cab6c-3573-405e-89ce-169dc6217e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:28Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Creating volume 695cab6c-3573-405e-89ce-169dc6217e66 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:31 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 1073741824 Sep 28 17:26:31 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa505edb-14fa-4692-9ada-35a6b44160c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cccd0d72-5bdb-4933-bc54-62d574603998', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95c395f-051e-4abe-a5b6-2afbbcc3c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (574b9edf-034a-41c4-ae1b-31eefe37e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494440d1-2eb3-4288-a8b2-6679546d5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:31 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:31 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Volume volume-cccd0d72-5bdb-4933-bc54-62d574603998 (cccd0d72-5bdb-4933-bc54-62d574603998): created successfully Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95c395f-051e-4abe-a5b6-2afbbcc3c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (bafd6549-2b1c-4ebb-80cd-4fc3aee4ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494440d1-2eb3-4288-a8b2-6679546d5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691450963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfba59c-e410-4dfa-b530-1f3e874b8215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88c1a8e-9ba2-4897-acb0-e1a8492ab32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88c1a8e-9ba2-4897-acb0-e1a8492ab32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9ae9d9-1c1c-48c1-9c4b-401ae43acb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9ae9d9-1c1c-48c1-9c4b-401ae43acb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfba59c-e410-4dfa-b530-1f3e874b8215', 'volume_name': 'volume-7dfba59c-e410-4dfa-b530-1f3e874b8215', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c949d89-f558-4291-a649-d82cd9294726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c949d89-f558-4291-a649-d82cd9294726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbdf8f0-855e-4871-94f0-d1a305dfed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume 7dfba59c-e410-4dfa-b530-1f3e874b8215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfba59c-e410-4dfa-b530-1f3e874b8215', 'volume_size': 1} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ab56440b-968c-425a-92c4-196fccf60c29 tempest-CreateVolumesFromImageTest-1031841267 None] Created volume successfully. Sep 28 17:26:31 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 0 in 0.685s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 1073741824" returned: 0 in 0.692s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:32 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 Sep 28 17:26:32 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 1 in 0.468s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Temporary image 7db7e647-b915-48a0-9248-0539526d8076 is fetched for user b854fd58b19047feb6b2eed34d7c5740. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (f5f9be28-a1cc-45c1-b200-4802d4a757ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72f3172-900b-466d-bc39-08fdc0573a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72f3172-900b-466d-bc39-08fdc0573a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539800095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7d851d-83c6-4729-8900-b42a7613b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80cf8e-a66d-4e97-b79e-4538f96c9868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80cf8e-a66d-4e97-b79e-4538f96c9868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2943dbf-0e7b-4fa4-ae98-055e24803300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2943dbf-0e7b-4fa4-ae98-055e24803300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7d851d-83c6-4729-8900-b42a7613b581', 'volume_name': 'volume-3a7d851d-83c6-4729-8900-b42a7613b581', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f8470a-c5b5-4b53-9954-11aca63c3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f8470a-c5b5-4b53-9954-11aca63c3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9267a798-79bc-4938-b0a4-25758f6e8179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume 3a7d851d-83c6-4729-8900-b42a7613b581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7d851d-83c6-4729-8900-b42a7613b581', 'volume_size': 1} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66" returned: 0 in 0.461s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1322224186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6f795e-453a-4e5a-932b-b7455aac9c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4422adefbce4005b4e12ac4761ec946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:29Z,use_quota=True,user_id='bf10aa8420ac4ed4a537099cf6b7de1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Creating volume fc6f795e-453a-4e5a-932b-b7455aac9c68 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:32 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 1073741824 Sep 28 17:26:32 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278e965-bce4-4a3c-873c-c6efbc29ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695cab6c-3573-405e-89ce-169dc6217e66', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caaa8a9-dabb-4cc2-a408-ab255ef9bac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Flow 'volume_create_manager' (8bc7fd60-aaa4-4ea9-b152-98a062d362ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d207250-c3ce-4bc9-a0c0-1150ff454bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e893d3d-602e-4475-98e1-b91fb29ddae3]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Volume volume-695cab6c-3573-405e-89ce-169dc6217e66 (695cab6c-3573-405e-89ce-169dc6217e66): created successfully Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caaa8a9-dabb-4cc2-a408-ab255ef9bac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (3a0507af-f53c-427a-bd60-76ceba4bb51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d207250-c3ce-4bc9-a0c0-1150ff454bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276e7e5-a8b3-46f7-9d3f-2980ea9904cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605641f02392461ca93149a417f90601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='ad5873c364074728bac1723750056afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6de3131-3137-4b56-b138-11f00e956a2c),volume_type_id=f6de3131-3137-4b56-b138-11f00e956a2c)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e6ff6-e38c-45a3-bfdd-2c042aef424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3e6ff6-e38c-45a3-bfdd-2c042aef424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea519cd5-e098-4d50-8304-3c8de0f44810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.image.glance [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Creating Keystone auth plugin from conf {{(pid=87034) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:26:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ad131155-4f89-455e-a271-352ba37ac94d tempest-CreateVolumesFromImageTest-1031841267 None] Created volume successfully. Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:32 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:32 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (9488bf19-58ae-4454-b91c-fac21517ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c948c592-dafb-44e0-a580-98a40536e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c948c592-dafb-44e0-a580-98a40536e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907462891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e4cf91-a5d9-4333-ac27-6db9100bee37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:33Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d2b80c-3319-4dbb-9c7e-adbb484180fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d2b80c-3319-4dbb-9c7e-adbb484180fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8181e35-545e-4db9-bcff-1fe9670daeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8181e35-545e-4db9-bcff-1fe9670daeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e4cf91-a5d9-4333-ac27-6db9100bee37', 'volume_name': 'volume-86e4cf91-a5d9-4333-ac27-6db9100bee37', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f3bdcb-eaab-4e71-b66c-59efac0f967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f3bdcb-eaab-4e71-b66c-59efac0f967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a072cf-4045-4353-b2af-601082ec5e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume 86e4cf91-a5d9-4333-ac27-6db9100bee37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e4cf91-a5d9-4333-ac27-6db9100bee37', 'volume_size': 1} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea519cd5-e098-4d50-8304-3c8de0f44810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7276e7e5-a8b3-46f7-9d3f-2980ea9904cb', 'volume_name': 'volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb', 'volume_size': 1, 'image_id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2c8c34d17ea42d7b1dc19fed79127b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '605641f02392461ca93149a417f90601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a12725c41f5ec456c858b291ea2fd27c836433b47165d343534d8d9c751f648ea8417d54937bef0c68a745f23dc2135fe3a63101a0fecfe851854fd22a3888ac', 'id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b438f2d0-8e60-43be-9add-21761e424e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b438f2d0-8e60-43be-9add-21761e424e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606a5ff2-62b2-49b3-9acc-6bb254ddf898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb', 'volume_size': 1, 'image_id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2c8c34d17ea42d7b1dc19fed79127b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '605641f02392461ca93149a417f90601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a12725c41f5ec456c858b291ea2fd27c836433b47165d343534d8d9c751f648ea8417d54937bef0c68a745f23dc2135fe3a63101a0fecfe851854fd22a3888ac', 'id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Trying to clone 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb from image b17904e1-7911-4409-9fd6-00d9e5d3aaca at location (None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}]). {{(pid=87034) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:26:33 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:33 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 1073741824" returned: 0 in 0.849s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:33 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 Sep 28 17:26:33 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5c7c4-a758-4fde-8de6-3660f18a50dc]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (58e2239b-a153-418b-9c3c-e6772b301ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a437068f-cfd4-42a5-89ec-ebdda4e5dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a437068f-cfd4-42a5-89ec-ebdda4e5dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199004111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1457a7-b1db-4c20-88c4-18786cd3f759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad575c-fd7a-40c1-84c3-279130ecca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ad575c-fd7a-40c1-84c3-279130ecca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663323d4-9148-4af5-b626-858602820bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663323d4-9148-4af5-b626-858602820bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1457a7-b1db-4c20-88c4-18786cd3f759', 'volume_name': 'volume-bf1457a7-b1db-4c20-88c4-18786cd3f759', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:33 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3916415d-8f14-494e-a882-e4b365e38a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3916415d-8f14-494e-a882-e4b365e38a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c591062c-37a7-4089-95d6-e2c508f27f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume bf1457a7-b1db-4c20-88c4-18786cd3f759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1457a7-b1db-4c20-88c4-18786cd3f759', 'volume_size': 1} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68" returned: 0 in 0.350s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91205178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:33 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf 1073741824 Sep 28 17:26:33 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab4d948-5503-4c0e-b382-69f9bf66f332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6f795e-453a-4e5a-932b-b7455aac9c68', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5745a24a-a240-4a36-ba09-59cabea7c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Volume volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 (fc6f795e-453a-4e5a-932b-b7455aac9c68): created successfully Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5745a24a-a240-4a36-ba09-59cabea7c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Flow 'volume_create_manager' (14186a3b-1964-4cd1-aed2-b2e7bcdfa967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:33 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5320ce4a-6442-4742-b04b-5563307e9f4d tempest-CreateVolumesFromImageTest-1031841267 None] Created volume successfully. Sep 28 17:26:33 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:34 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf 1073741824" returned: 0 in 0.550s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Temporary image b17904e1-7911-4409-9fd6-00d9e5d3aaca is fetched for user ad5873c364074728bac1723750056afd. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf Sep 28 17:26:34 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5686497-1051-4c5d-9cdc-348a8848e4bf]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:34 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-fc6f795e-453a-4e5a-932b-b7455aac9c68-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-fc6f795e-453a-4e5a-932b-b7455aac9c68-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-quobyte-fc6f795e-453a-4e5a-932b-b7455aac9c68" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-fc6f795e-453a-4e5a-932b-b7455aac9c68" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:34 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.312s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691450963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfba59c-e410-4dfa-b530-1f3e874b8215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume 7dfba59c-e410-4dfa-b530-1f3e874b8215 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffffe29-37d8-45db-bf08-5cae1ab5b821]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 1073741824 Sep 28 17:26:34 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2778adb6-079c-4904-a40b-6d77acd5a782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de5ed1f-a872-48d9-b763-d42151eae76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf (fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf): created successfully Sep 28 17:26:34 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de5ed1f-a872-48d9-b763-d42151eae76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (7a121ba3-6ddc-484f-9db8-ef4ed5dcaabd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9544ed0a-0331-4632-bbae-b8aa3bc4a99c tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:35 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 Sep 28 17:26:35 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:35 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68" returned: 0 in 0.488s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68 Sep 28 17:26:35 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 1073741824" returned: 0 in 0.587s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 Sep 28 17:26:35 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fc6f795e-453a-4e5a-932b-b7455aac9c68" returned: 0 in 0.297s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-fc6f795e-453a-4e5a-932b-b7455aac9c68" released by "delete_volume" :: held 0.865s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Created reservations ['4530ce24-b5f4-4e88-b659-5cb178db64ad', 'b788e9e3-9678-48d9-b1a0-331b22fcfb51', '7c666f0a-4ec3-4eed-a728-e3b0971d1adb', 'ad9e7de3-d36f-4759-9576-a0bd59ba85ca'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:35 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.271s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-539800095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7d851d-83c6-4729-8900-b42a7613b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume 3a7d851d-83c6-4729-8900-b42a7613b581 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:35 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbdf8f0-855e-4871-94f0-d1a305dfed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfba59c-e410-4dfa-b530-1f3e874b8215', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e086b157-00de-4e90-a8da-a96efa851094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 1073741824 Sep 28 17:26:35 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 (7dfba59c-e410-4dfa-b530-1f3e874b8215): created successfully Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e086b157-00de-4e90-a8da-a96efa851094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (574b9edf-034a-41c4-ae1b-31eefe37e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:35 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:35 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f3c4abd8-1d2f-4dfa-9a2e-2be4ea5921e8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-695cab6c-3573-405e-89ce-169dc6217e66-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-695cab6c-3573-405e-89ce-169dc6217e66-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-quobyte-695cab6c-3573-405e-89ce-169dc6217e66" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-695cab6c-3573-405e-89ce-169dc6217e66" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643b336-932b-48c4-ab36-d50e52ebc866]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.329s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Deleted volume successfully. Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-7f2b0163-455f-49e3-b444-516145e03f78 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-fc6f795e-453a-4e5a-932b-b7455aac9c68-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:36 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 Sep 28 17:26:36 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 1073741824" returned: 0 in 0.608s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 Sep 28 17:26:36 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66" returned: 0 in 0.443s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66 Sep 28 17:26:36 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581" returned: 0 in 0.272s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.757s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907462891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e4cf91-a5d9-4333-ac27-6db9100bee37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:33Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume 86e4cf91-a5d9-4333-ac27-6db9100bee37 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:36 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9267a798-79bc-4938-b0a4-25758f6e8179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7d851d-83c6-4729-8900-b42a7613b581', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 1073741824 Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a2eb2-3841-4620-a5a6-35273aacb25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-3a7d851d-83c6-4729-8900-b42a7613b581 (3a7d851d-83c6-4729-8900-b42a7613b581): created successfully Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63a2eb2-3841-4620-a5a6-35273aacb25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (f5f9be28-a1cc-45c1-b200-4802d4a757ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:36 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-767a0426-29ee-4076-8d56-b89b0aaa27c8 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:36 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-695cab6c-3573-405e-89ce-169dc6217e66" returned: 0 in 0.282s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-695cab6c-3573-405e-89ce-169dc6217e66" released by "delete_volume" :: held 0.782s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:36 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Created reservations ['745456c6-0452-40a6-a629-32726f828db8', '253a6e1c-3c6d-40ff-9b8b-0f69347a6a02', 'd48f639b-5f12-4b41-b362-4b29b61e6a24', '51efb953-0f66-41d4-9617-951652f3febb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:37 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-cccd0d72-5bdb-4933-bc54-62d574603998-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-cccd0d72-5bdb-4933-bc54-62d574603998-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:37 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-quobyte-cccd0d72-5bdb-4933-bc54-62d574603998" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:37 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Deleted volume successfully. Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 1073741824" returned: 0 in 0.538s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-cccd0d72-5bdb-4933-bc54-62d574603998" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b192a977-e9bf-42c2-a6e1-2cc6b24c6af4 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-695cab6c-3573-405e-89ce-169dc6217e66-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e86d3cc-7db5-4827-87f6-5e621f40bba0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 Sep 28 17:26:37 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 Sep 28 17:26:37 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37" returned: 0 in 0.259s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.902s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199004111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1457a7-b1db-4c20-88c4-18786cd3f759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf939b13364d3484f68f8d4861e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='53925e0be682476b882842baf4095ae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Creating volume bf1457a7-b1db-4c20-88c4-18786cd3f759 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:37 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 1073741824 Sep 28 17:26:37 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a072cf-4045-4353-b2af-601082ec5e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e4cf91-a5d9-4333-ac27-6db9100bee37', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e8f65e-75da-47cc-ac62-6a2e95e8c2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:37 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 (86e4cf91-a5d9-4333-ac27-6db9100bee37): created successfully Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e8f65e-75da-47cc-ac62-6a2e95e8c2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (9488bf19-58ae-4454-b91c-fac21517ee10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:37 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-46c6300d-8908-4c99-9380-d03cb2b79500 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:37 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998" returned: 0 in 0.429s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998 Sep 28 17:26:37 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-cccd0d72-5bdb-4933-bc54-62d574603998" returned: 0 in 0.292s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-cccd0d72-5bdb-4933-bc54-62d574603998" released by "delete_volume" :: held 0.775s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 1073741824" returned: 0 in 0.457s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Created reservations ['283b6ad8-141d-44df-bef8-ef518a752441', '82b5eff0-c9a0-47de-976c-cfef1f7018f1', '52c29539-bea9-4a01-889a-c3f6f24ce976', 'd39831e7-01a4-4076-ad5b-1f9fda64082e'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:38 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 Sep 28 17:26:38 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:38 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-16eea01d-4a31-4972-bdf9-cc99929bb179-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759" returned: 0 in 0.268s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.701s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae9dc28-9aeb-419d-b539-5643f91faffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea1cbe48ddb443dba301fb5be5d098b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='b854fd58b19047feb6b2eed34d7c5740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Creating volume 3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-16eea01d-4a31-4972-bdf9-cc99929bb179-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:38 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1073741824 Sep 28 17:26:38 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c591062c-37a7-4089-95d6-e2c508f27f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1457a7-b1db-4c20-88c4-18786cd3f759', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:38 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7235945e-a3b0-4f36-9866-3771ffc9458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.286s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Deleted volume successfully. Sep 28 17:26:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Volume volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 (bf1457a7-b1db-4c20-88c4-18786cd3f759): created successfully Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7235945e-a3b0-4f36-9866-3771ffc9458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Flow 'volume_create_manager' (58e2239b-a153-418b-9c3c-e6772b301ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-47c5f949-4bcb-4dc5-865a-3bdb594461c2 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created volume successfully. Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-quobyte-16eea01d-4a31-4972-bdf9-cc99929bb179" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-51359ce1-fb28-455f-aa3d-e4f48c58308a tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-cccd0d72-5bdb-4933-bc54-62d574603998-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-16eea01d-4a31-4972-bdf9-cc99929bb179" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d5f6f-ccf1-4dae-b23b-3d287606d678]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 Sep 28 17:26:38 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1073741824" returned: 0 in 0.506s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd Sep 28 17:26:39 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-bf1457a7-b1db-4c20-88c4-18786cd3f759-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-bf1457a7-b1db-4c20-88c4-18786cd3f759-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179" returned: 0 in 0.445s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179 Sep 28 17:26:39 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-bf1457a7-b1db-4c20-88c4-18786cd3f759" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-bf1457a7-b1db-4c20-88c4-18786cd3f759" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0550320-e6e7-4b9e-bbe3-3475a630e19a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd" returned: 0 in 0.292s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.934s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7276e7e5-a8b3-46f7-9d3f-2980ea9904cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605641f02392461ca93149a417f90601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='ad5873c364074728bac1723750056afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6de3131-3137-4b56-b138-11f00e956a2c),volume_type_id=f6de3131-3137-4b56-b138-11f00e956a2c)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Creating volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:39 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 Sep 28 17:26:39 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:39 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1073741824 Sep 28 17:26:39 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Attempting download of 7db7e647-b915-48a0-9248-0539526d8076 ((None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}])) to volume 3ae9dc28-9aeb-419d-b539-5643f91faffd. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:26:39 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16eea01d-4a31-4972-bdf9-cc99929bb179" returned: 0 in 0.315s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[603bbea8-1f0c-46ae-90d3-bb89e08db3d8]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-16eea01d-4a31-4972-bdf9-cc99929bb179" released by "delete_volume" :: held 0.841s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Created reservations ['1cb87735-e36e-4636-8018-b3ad936508b3', '0bbf6870-817f-42ca-bfa8-fc3f071cc333', '7d4962f2-adc6-455f-bd3a-1fa022f997b7', 'd5c60f83-691d-4856-bd45-fb2a2c73c344'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:39 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2 Sep 28 17:26:39 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:39 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759" returned: 0 in 0.454s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759 Sep 28 17:26:39 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-9080e9e1-49f5-4cab-9baf-b58eed74b8a7-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:39 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-9080e9e1-49f5-4cab-9baf-b58eed74b8a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "cinder-quobyte-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" acquired by "delete_volume" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e3afd-e71d-44c5-bd41-ba85c35e63e0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2" returned: 0 in 0.557s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 Sep 28 17:26:40 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1073741824" returned: 0 in 0.728s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.404s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Deleted volume successfully. Sep 28 17:26:40 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-bf1457a7-b1db-4c20-88c4-18786cd3f759" returned: 0 in 0.425s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-bf1457a7-b1db-4c20-88c4-18786cd3f759" released by "delete_volume" :: held 0.939s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1da13f55-f7b0-4d0e-bc39-a3a96dd285b3 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-16eea01d-4a31-4972-bdf9-cc99929bb179-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb Sep 28 17:26:40 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2 Sep 28 17:26:40 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['bfdf310c-f2cb-4698-926b-3672901de6fb', '468af545-1ade-4313-bdbb-b79ae01da433', '8ea97c01-cebb-42dd-8f69-7fc1f7eddbb0', '0d4b28e9-c308-4660-a07c-c5050d2e0afb'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:40 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" returned: 0 in 0.500s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7 Sep 28 17:26:40 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2" returned: 1 in 0.478s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7db7e647-b915-48a0-9248-0539526d8076_orfcexa2' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[824855ee-4737-443f-945a-53ae17295ab6]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" returned: 0 in 0.365s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Attempting download of b17904e1-7911-4409-9fd6-00d9e5d3aaca ((None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}])) to volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb984053-aa70-411a-9bfa-af0e0200ed70]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:40 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:40 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" returned: 0 in 0.291s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-quobyte-9080e9e1-49f5-4cab-9baf-b58eed74b8a7" released by "delete_volume" :: held 0.868s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c57885c0-fe0d-4936-8a47-dca4834a66b7 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-bf1457a7-b1db-4c20-88c4-18786cd3f759-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:40 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md Sep 28 17:26:40 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Created reservations ['8742d7f7-d26f-44cd-959a-2af0c96f413a', '63758bc7-bae9-4d56-a48a-2b65c5c4b669', 'b07fc299-874b-4946-b91c-2980e2aac357', 'fde12394-9d8c-4c8c-b3b8-b5d86f78b085'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:40 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:41 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD Sep 28 17:26:41 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md" returned: 0 in 0.583s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md Sep 28 17:26:41 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.395s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Deleted volume successfully. Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-467cc005-8dfb-4547-8866-a475d4fdc407 tempest-CreateVolumesFromImageTest-1031841267 None] Lock "cinder-9080e9e1-49f5-4cab-9baf-b58eed74b8a7-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:41 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] 7db7e647-b915-48a0-9248-0539526d8076 was raw, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd Sep 28 17:26:41 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-86e4cf91-a5d9-4333-ac27-6db9100bee37-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md" returned: 1 in 0.494s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17904e1-7911-4409-9fd6-00d9e5d3aaca_xy20g6md' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[16103eb5-7f0e-4432-8f83-88d5ffa229ff]: (4, 'raw') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-86e4cf91-a5d9-4333-ac27-6db9100bee37-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-86e4cf91-a5d9-4333-ac27-6db9100bee37" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-86e4cf91-a5d9-4333-ac27-6db9100bee37" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cc9d31-d4b5-4482-9959-5d86bf23d594]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:41 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 Sep 28 17:26:42 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd" returned: 0 in 0.693s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7db7e647-b915-48a0-9248-0539526d8076_xmttin49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:42 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1G Sep 28 17:26:42 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD Sep 28 17:26:42 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37" returned: 0 in 0.678s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37 Sep 28 17:26:42 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd 1G" returned: 0 in 0.402s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Downloaded image 7db7e647-b915-48a0-9248-0539526d8076 ((None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}])) to volume 3ae9dc28-9aeb-419d-b539-5643f91faffd successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Temporary image 7db7e647-b915-48a0-9248-0539526d8076 for user b854fd58b19047feb6b2eed34d7c5740 is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Marking volume 3ae9dc28-9aeb-419d-b539-5643f91faffd as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Copying metadata from image 7db7e647-b915-48a0-9248-0539526d8076 to 3ae9dc28-9aeb-419d-b539-5643f91faffd. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Creating volume glance metadata for volume 3ae9dc28-9aeb-419d-b539-5643f91faffd backed by image 7db7e647-b915-48a0-9248-0539526d8076 with: {'image_id': '7db7e647-b915-48a0-9248-0539526d8076', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e2de63fe843a608e8ebfdfccd6a14767', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:26:42 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] b17904e1-7911-4409-9fd6-00d9e5d3aaca was raw, converting to qcow2 {{(pid=87034) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1cd0e5-3ccd-43f3-b7e4-4cfd1d7ce968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae9dc28-9aeb-419d-b539-5643f91faffd', 'volume_size': 1, 'image_id': '7db7e647-b915-48a0-9248-0539526d8076', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7db7e647-b915-48a0-9248-0539526d8076', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2de63fe843a608e8ebfdfccd6a14767', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dea1cbe48ddb443dba301fb5be5d098b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86cbef70c7de6d872e0e035167264eeb578354bf30a9c1ed801fe65250a8275f1c7a7e29534d771893cc262ef4cacb43cfb1bf90634a9dedfd6bd782c752d021', 'id': '7db7e647-b915-48a0-9248-0539526d8076', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7db7e647-b915-48a0-9248-0539526d8076/file', 'properties': {}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fddcb2-153f-4340-b78f-fb7aec7bf956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:42 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb Sep 28 17:26:42 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Volume volume-3ae9dc28-9aeb-419d-b539-5643f91faffd (3ae9dc28-9aeb-419d-b539-5643f91faffd): created successfully Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fddcb2-153f-4340-b78f-fb7aec7bf956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Flow 'volume_create_manager' (acd708d8-3595-4a12-af0b-88ea5dcbad51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-88db98b7-0969-4855-9894-aa155c6b6ca0 tempest-VolumeImageDependencyTests-752400860 None] Created volume successfully. Sep 28 17:26:42 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-86e4cf91-a5d9-4333-ac27-6db9100bee37" returned: 0 in 0.336s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-86e4cf91-a5d9-4333-ac27-6db9100bee37" released by "delete_volume" :: held 1.063s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:42 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['f9b3dd03-46cf-41fd-8b7d-f543aadf74ba', '17f85b82-d95a-4404-8a82-86e290f0ab68', 'e21965e0-0c5a-42ba-9f4d-25ccae6331bb', '8c39216c-f717-44fc-9015-b79466576152'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:43 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Acquiring lock "cinder-3ae9dc28-9aeb-419d-b539-5643f91faffd-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "cinder-3ae9dc28-9aeb-419d-b539-5643f91faffd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Acquiring lock "cinder-quobyte-3ae9dc28-9aeb-419d-b539-5643f91faffd" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "cinder-quobyte-3ae9dc28-9aeb-419d-b539-5643f91faffd" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" returned: 0 in 0.765s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b17904e1-7911-4409-9fd6-00d9e5d3aaca_rd259h1zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:43 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a741072-bc3b-43bb-96c4-844bf182e181]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1G Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.405s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:43 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-878cc91c-e27c-40d1-8002-cfd40066284b tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-86e4cf91-a5d9-4333-ac27-6db9100bee37-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd Sep 28 17:26:43 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb 1G" returned: 0 in 0.412s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Downloaded image b17904e1-7911-4409-9fd6-00d9e5d3aaca ((None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}])) to volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb successfully. {{(pid=87034) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Temporary image b17904e1-7911-4409-9fd6-00d9e5d3aaca for user ad5873c364074728bac1723750056afd is deleted. {{(pid=87034) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.volume_utils [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Marking volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb as bootable. {{(pid=87034) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Copying metadata from image b17904e1-7911-4409-9fd6-00d9e5d3aaca to 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb. {{(pid=87034) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Creating volume glance metadata for volume 7276e7e5-a8b3-46f7-9d3f-2980ea9904cb backed by image b17904e1-7911-4409-9fd6-00d9e5d3aaca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf2c8c34d17ea42d7b1dc19fed79127b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87034) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:26:43 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd" returned: 0 in 0.514s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd Sep 28 17:26:43 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606a5ff2-62b2-49b3-9acc-6bb254ddf898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb', 'volume_size': 1, 'image_id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2c8c34d17ea42d7b1dc19fed79127b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '605641f02392461ca93149a417f90601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a12725c41f5ec456c858b291ea2fd27c836433b47165d343534d8d9c751f648ea8417d54937bef0c68a745f23dc2135fe3a63101a0fecfe851854fd22a3888ac', 'id': 'b17904e1-7911-4409-9fd6-00d9e5d3aaca', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17904e1-7911-4409-9fd6-00d9e5d3aaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b354b-414c-4958-93a2-0dd7191c19c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-3a7d851d-83c6-4729-8900-b42a7613b581-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Volume volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb (7276e7e5-a8b3-46f7-9d3f-2980ea9904cb): created successfully Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505b354b-414c-4958-93a2-0dd7191c19c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Flow 'volume_create_manager' (8bc7fd60-aaa4-4ea9-b152-98a062d362ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-3a7d851d-83c6-4729-8900-b42a7613b581-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d525a801-c011-498f-a219-ae791c7c6a8a tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Created volume successfully. Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-3a7d851d-83c6-4729-8900-b42a7613b581" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-3a7d851d-83c6-4729-8900-b42a7613b581" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7210cb1-2085-4143-a836-ec432a6f6734]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ae9dc28-9aeb-419d-b539-5643f91faffd" returned: 0 in 0.349s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "cinder-quobyte-3ae9dc28-9aeb-419d-b539-5643f91faffd" released by "delete_volume" :: held 0.962s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:44 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 Sep 28 17:26:44 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Acquiring lock "cinder-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "cinder-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Created reservations ['beb63b9f-ff10-4a18-9436-25b18c8b7f18', 'b74bd056-40b9-4ed9-85ee-1502d9bb19b4', 'af3a44a9-9351-45ef-8805-ce2c3ef70f71', '03302ffd-f87c-4a3a-8c48-d8511c6aa5f4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Acquiring lock "cinder-quobyte-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "cinder-quobyte-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7664d8a1-da49-4b5e-9125-8e39c528d82e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:44 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb Sep 28 17:26:44 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581" returned: 0 in 0.589s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581 Sep 28 17:26:44 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Deleted volume successfully. Sep 28 17:26:44 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-426159e1-d9b4-4628-ab4c-8ed43ad02142 tempest-VolumeImageDependencyTests-752400860 None] Lock "cinder-3ae9dc28-9aeb-419d-b539-5643f91faffd-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" returned: 0 in 0.495s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb Sep 28 17:26:45 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3a7d851d-83c6-4729-8900-b42a7613b581" returned: 0 in 0.332s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-3a7d851d-83c6-4729-8900-b42a7613b581" released by "delete_volume" :: held 0.980s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['f72e0778-5483-497b-aeaf-1b2b1b82c6bf', '0d7d96c6-0de0-4a68-8841-422fe7815268', 'f80a9790-a544-4d4a-aa05-a70a119e8c42', '5eff1000-45a8-4aec-bcc9-87c0ed42c1c5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:45 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "cinder-quobyte-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb" released by "delete_volume" :: held 0.925s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Created reservations ['4e901edb-ffbf-47b4-8c53-a576bd406c3b', '67ab62d6-1abd-4ab9-82b2-6726f62e51da', 'deb9167c-5459-4838-98d3-59bb114e7402', '3f9f481a-15bc-4d78-b98e-b8308668ab89'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.357s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:45 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:45 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-dcc7953a-775a-4dfb-82a1-bc3a4e62f33d tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-3a7d851d-83c6-4729-8900-b42a7613b581-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.320s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:46 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Deleted volume successfully. Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c22d11f3-4d8a-481c-b0a5-d1b3364ecfb2 tempest-VolumeAndVolumeTypeFromImageTest-1326643335 None] Lock "cinder-7276e7e5-a8b3-46f7-9d3f-2980ea9904cb-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-7dfba59c-e410-4dfa-b530-1f3e874b8215-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (4753bc77-23d6-44cd-aae6-6dc88f9babe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1c0f91-c627-41ee-a3b8-dd45cc5a12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1c0f91-c627-41ee-a3b8-dd45cc5a12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639673705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75e7aaf-d11c-49da-8e0c-38152be0639c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:46Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec837fe-b9a7-4c54-b238-eee03b6ac437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec837fe-b9a7-4c54-b238-eee03b6ac437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff0580-c45a-4100-93fa-8edc32d18d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff0580-c45a-4100-93fa-8edc32d18d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75e7aaf-d11c-49da-8e0c-38152be0639c', 'volume_name': 'volume-b75e7aaf-d11c-49da-8e0c-38152be0639c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac13942e-97b8-4244-a30d-2027f768384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac13942e-97b8-4244-a30d-2027f768384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c974b-bc47-436e-b100-f3bca975116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Volume b75e7aaf-d11c-49da-8e0c-38152be0639c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75e7aaf-d11c-49da-8e0c-38152be0639c', 'volume_size': 1} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639673705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75e7aaf-d11c-49da-8e0c-38152be0639c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:46Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Creating volume b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:46 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-7dfba59c-e410-4dfa-b530-1f3e874b8215-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:46 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c 1073741824 Sep 28 17:26:46 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-7dfba59c-e410-4dfa-b530-1f3e874b8215" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-7dfba59c-e410-4dfa-b530-1f3e874b8215" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d778981-8089-46cc-8c7d-27f45e547f43]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:46 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 Sep 28 17:26:46 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c 1073741824" returned: 0 in 0.590s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c Sep 28 17:26:47 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215" returned: 0 in 0.633s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215 Sep 28 17:26:47 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c" returned: 0 in 0.337s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c974b-bc47-436e-b100-f3bca975116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75e7aaf-d11c-49da-8e0c-38152be0639c', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462e6272-15ea-4cd6-bdae-30a0cee9b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:47 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Volume volume-b75e7aaf-d11c-49da-8e0c-38152be0639c (b75e7aaf-d11c-49da-8e0c-38152be0639c): created successfully Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462e6272-15ea-4cd6-bdae-30a0cee9b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (4753bc77-23d6-44cd-aae6-6dc88f9babe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b3b12f47-c071-4aed-84b5-9826d12a0245 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:26:47 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7dfba59c-e410-4dfa-b530-1f3e874b8215" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-7dfba59c-e410-4dfa-b530-1f3e874b8215" released by "delete_volume" :: held 1.075s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['a5e5a0e8-36f2-47ce-81f3-9b1251411e0d', '8d991085-d897-4b61-bce1-3e088da8abb2', '7972bdd3-2ab6-499a-a4f2-b1c8abd2a60c', '874dbd60-d059-45e2-897d-22463c7acab2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:47 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:48 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:48 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-76cf7d9a-6301-43f4-9a05-1add26304d82 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-7dfba59c-e410-4dfa-b530-1f3e874b8215-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be9c29e-fb2c-49f5-aee2-cf89f4af0d8c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf Sep 28 17:26:49 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot 45407651-988c-43e5-aaf6-dd7328893eb7 of volume b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad0df63-6499-4a0b-b253-e8ccea06c79a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c Sep 28 17:26:49 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" returned: 0 in 0.677s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf Sep 28 17:26:49 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c" returned: 0 in 0.480s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 1G Sep 28 17:26:49 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" returned: 0 in 0.340s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf" released by "delete_volume" :: held 1.113s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:49 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['1290f56e-1533-4c19-9300-6c2e56be2790', 'dd3c8830-7ea6-4e1b-9579-e5055c9dc187', 'fedd2b4c-c329-4592-8944-e26863d87f99', 'd171aeac-2e64-49d4-b177-ddb4eacab674'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:50 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 1G" returned: 0 in 0.704s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75e7aaf-d11c-49da-8e0c-38152be0639c -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:50 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75e7aaf-d11c-49da-8e0c-38152be0639c -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 Sep 28 17:26:50 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d3b34211-d4d5-4ff0-a100-605d538797f3 tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-fd33add9-feb9-4f5a-b02f-7f1ea9be4cbf-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:50 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75e7aaf-d11c-49da-8e0c-38152be0639c -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7" returned: 0 in 0.391s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 is being set with open permissions: ugo+rw Sep 28 17:26:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 Sep 28 17:26:50 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-00a3ac96-c5ad-4f4b-ade4-029c706b95dc-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-00a3ac96-c5ad-4f4b-ade4-029c706b95dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "cinder-quobyte-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c88616-99b0-4fee-b63b-ede370256fb0]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7" returned: 0 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc Sep 28 17:26:51 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info Sep 28 17:26:51 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" returned: 0 in 0.446s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info is being set with open permissions: ugo+rw Sep 28 17:26:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc Sep 28 17:26:51 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info Sep 28 17:26:51 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-quobyte-00a3ac96-c5ad-4f4b-ade4-029c706b95dc" released by "delete_volume" :: held 0.854s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.info" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Created reservations ['b8bdb142-8a8c-42d5-a1de-c2487a26b354', '6f1803ca-28ea-4e09-9fef-d0d01c7dfb8c', '889c3380-0c52-4ef3-ab42-7c9739fd6bfd', 'ce6e339b-3743-4fc9-afcd-a308269924f9'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-49e0170e-deb4-43cc-a397-b9656f279bf0 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:52 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-45407651-988c-43e5-aaf6-dd7328893eb7-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-45407651-988c-43e5-aaf6-dd7328893eb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-45407651-988c-43e5-aaf6-dd7328893eb7" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-45407651-988c-43e5-aaf6-dd7328893eb7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot 45407651-988c-43e5-aaf6-dd7328893eb7 of volume b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4614fa50-3388-4c42-8ae7-8255c7280b16]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.373s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Deleted volume successfully. Sep 28 17:26:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c399b919-09ab-4401-b127-b1b23897bede tempest-CreateVolumesFromSourceVolumeTest-587705689 None] Lock "cinder-00a3ac96-c5ad-4f4b-ade4-029c706b95dc-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 Sep 28 17:26:52 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:53 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7" returned: 0 in 0.478s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75e7aaf-d11c-49da-8e0c-38152be0639c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d4587-a286-4eb0-bde0-03f8fdbb69ad]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:53 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c Sep 28 17:26:53 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:53 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c" returned: 0 in 0.458s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:53 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 Sep 28 17:26:53 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7" returned: 0 in 0.496s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:54 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7 Sep 28 17:26:54 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c.45407651-988c-43e5-aaf6-dd7328893eb7" returned: 0 in 0.357s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-45407651-988c-43e5-aaf6-dd7328893eb7" released by "_delete_snapshot" :: held 2.031s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" released by "delete_snapshot" :: held 2.079s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (14e8408b-0a7e-44ab-b3ba-0bac4c5ef118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a196d58-0990-4beb-93b2-235fcc4cee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a196d58-0990-4beb-93b2-235fcc4cee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-151133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d745752-ce34-4798-a157-8284d66fe253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:54Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1cda73-7e3f-4d53-b957-9867335e81e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1cda73-7e3f-4d53-b957-9867335e81e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f95fe05-24db-41eb-96d9-34ac270d6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f95fe05-24db-41eb-96d9-34ac270d6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d745752-ce34-4798-a157-8284d66fe253', 'volume_name': 'volume-3d745752-ce34-4798-a157-8284d66fe253', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6400a06-a0c1-4531-8a24-02e77adcec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6400a06-a0c1-4531-8a24-02e77adcec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e988e0f-0d5d-4118-89da-79dc51e44600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 3d745752-ce34-4798-a157-8284d66fe253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d745752-ce34-4798-a157-8284d66fe253', 'volume_size': 1} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-151133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d745752-ce34-4798-a157-8284d66fe253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:54Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:54 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:54 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 1073741824 Sep 28 17:26:54 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Created reservations ['51ce3997-c54e-4494-82ce-c08435764adf', 'c995cd52-4475-48b3-b716-11c161c62fd8', 'b3fc0b29-a992-4032-b518-0095470e825c', '947320e5-5ce0-467b-9961-67fbedcf6fa3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:26:54 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-efb152af-d3b0-49be-9cdf-2ada94018c07 tempest-ProjectMemberTests-510569012 None] Lock "cinder-45407651-988c-43e5-aaf6-dd7328893eb7-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:55 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 1073741824" returned: 0 in 0.646s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:55 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 Sep 28 17:26:55 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-b75e7aaf-d11c-49da-8e0c-38152be0639c-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "cinder-b75e7aaf-d11c-49da-8e0c-38152be0639c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:55 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253" returned: 0 in 0.369s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e988e0f-0d5d-4118-89da-79dc51e44600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d745752-ce34-4798-a157-8284d66fe253', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1d43d5-108b-45e8-b5dc-1e4eb8e4851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-3d745752-ce34-4798-a157-8284d66fe253 (3d745752-ce34-4798-a157-8284d66fe253): created successfully Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1d43d5-108b-45e8-b5dc-1e4eb8e4851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (14e8408b-0a7e-44ab-b3ba-0bac4c5ef118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" acquired by "delete_volume" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6aa1bd31-b637-4780-a024-1e0a999b016a tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f465778b-84f1-4f87-b2bb-bc39887006a5]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:56 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c Sep 28 17:26:56 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:56 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c" returned: 0 in 0.443s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:56 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c Sep 28 17:26:56 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:56 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b75e7aaf-d11c-49da-8e0c-38152be0639c" returned: 0 in 0.428s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b75e7aaf-d11c-49da-8e0c-38152be0639c" released by "delete_volume" :: held 1.004s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:56 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Created reservations ['75ee989d-0d67-4e5a-8da1-db677b72fd9e', '4a839046-ea0b-4b21-9713-3f695abd74de', 'bd9b6276-fc43-4193-89cd-dc1e2fe76995', '7915b052-dc60-467c-bbc9-871a31ae5807'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating offline snapshot 19f4ff84-2494-4964-a376-56a82523c2b1 of volume 3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:57 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:26:57 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Flow 'volume_create_manager' (e3adf5d1-f595-48a3-91a1-2ebdf219fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb010abc-5935-4b37-946c-0b73573faeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155a3e0-3844-4f36-a0c7-cd773e2c8446]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb010abc-5935-4b37-946c-0b73573faeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-439031031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99433b4-3ca3-45b5-b6af-77383301a950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c08b026b36944c58ca05cf53d389a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:57Z,use_quota=True,user_id='e84caff6dae0475db2c2de3d95243f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b1ef7e-85f5-4bc1-a520-6a4f4e45525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b1ef7e-85f5-4bc1-a520-6a4f4e45525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1794b779-8214-462d-a0cd-53757dab920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1794b779-8214-462d-a0cd-53757dab920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99433b4-3ca3-45b5-b6af-77383301a950', 'volume_name': 'volume-e99433b4-3ca3-45b5-b6af-77383301a950', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e06361-c7a6-4855-93b8-9cb5fccd1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e06361-c7a6-4855-93b8-9cb5fccd1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa2ebcc-7a5a-483c-a97a-3bea55277f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:57 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Volume e99433b4-3ca3-45b5-b6af-77383301a950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99433b4-3ca3-45b5-b6af-77383301a950', 'volume_size': 1} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:57 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 Sep 28 17:26:57 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:57 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.297s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-88f9de78-6d0a-452c-9977-9edca67c0416 tempest-ProjectMemberTests-510569012 None] Lock "cinder-b75e7aaf-d11c-49da-8e0c-38152be0639c-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:57 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253" returned: 0 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 1G Sep 28 17:26:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 1G" returned: 0 in 0.502s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d745752-ce34-4798-a157-8284d66fe253 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d745752-ce34-4798-a157-8284d66fe253 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 Sep 28 17:26:58 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d745752-ce34-4798-a157-8284d66fe253 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1" returned: 0 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:58 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 is being set with open permissions: ugo+rw Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 Sep 28 17:26:58 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (2c9a96c0-2127-44a0-9d8d-932ef2514a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a230fed7-21fb-476f-8b1b-63034b8a12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a230fed7-21fb-476f-8b1b-63034b8a12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760576085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e10cdf-9d2b-4161-a074-dc9c96fb7bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:59Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d7322f-64dd-4cc6-90a5-854fc62037e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d7322f-64dd-4cc6-90a5-854fc62037e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2736db13-b597-4b46-9a7f-e26c61f00c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2736db13-b597-4b46-9a7f-e26c61f00c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e10cdf-9d2b-4161-a074-dc9c96fb7bdd', 'volume_name': 'volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f8ed4-4995-4066-937d-9489be47b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (322f8ed4-4995-4066-937d-9489be47b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d2bed5-dac9-4cf1-bda7-23f1d3b9a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Volume 74e10cdf-9d2b-4161-a074-dc9c96fb7bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd', 'volume_size': 1} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:58 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1" returned: 0 in 0.300s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info Sep 28 17:26:58 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info" returned: 0 in 0.316s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info is being set with open permissions: ugo+rw Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info Sep 28 17:26:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.info" returned: 0 in 0.272s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-439031031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99433b4-3ca3-45b5-b6af-77383301a950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c08b026b36944c58ca05cf53d389a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:57Z,use_quota=True,user_id='e84caff6dae0475db2c2de3d95243f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Creating volume e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:26:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 1073741824 Sep 28 17:26:59 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1a533814-f480-4261-8b40-d696cd5ca508 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Create snapshot completed successfully Sep 28 17:27:00 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 1073741824" returned: 0 in 0.517s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:00 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:00 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:00 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760576085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e10cdf-9d2b-4161-a074-dc9c96fb7bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:59Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Creating volume 74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:00 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa2ebcc-7a5a-483c-a97a-3bea55277f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99433b4-3ca3-45b5-b6af-77383301a950', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a277a4-1125-43cc-a02d-afb65a82f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd 1073741824 Sep 28 17:27:00 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Volume volume-e99433b4-3ca3-45b5-b6af-77383301a950 (e99433b4-3ca3-45b5-b6af-77383301a950): created successfully Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a277a4-1125-43cc-a02d-afb65a82f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Flow 'volume_create_manager' (e3adf5d1-f595-48a3-91a1-2ebdf219fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-29ccdf84-747a-48c1-8d04-4c79d1d886f6 tempest-VolumeDependencyTests-299158267 None] Created volume successfully. Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (c32ee583-85ad-4362-b9eb-c417bb292676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c519dfd1-b80d-4ccd-b105-f7ec2582d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c519dfd1-b80d-4ccd-b105-f7ec2582d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031297842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dafffa-787d-43c6-8088-86fd06694027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:01Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2738acd-3dd1-43c8-8cf8-0d57024bc41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2738acd-3dd1-43c8-8cf8-0d57024bc41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94e524-07ca-4719-abce-e3276d85eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94e524-07ca-4719-abce-e3276d85eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dafffa-787d-43c6-8088-86fd06694027', 'volume_name': 'volume-73dafffa-787d-43c6-8088-86fd06694027', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f6c332-ffa4-43d9-a325-d79a8439a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f6c332-ffa4-43d9-a325-d79a8439a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c856726-af83-48c6-8de7-64f3a2ffc481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 73dafffa-787d-43c6-8088-86fd06694027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dafffa-787d-43c6-8088-86fd06694027', 'volume_size': 1} Sep 28 17:27:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:01 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd 1073741824" returned: 0 in 0.741s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:01 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd Sep 28 17:27:01 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (70ccbcd7-df63-478f-8f6e-f3b06c0f7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a53e531-34ee-4040-a9e3-4ca40e66ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a53e531-34ee-4040-a9e3-4ca40e66ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854519069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747e88b-3113-44f1-89b5-354ad2280880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:01Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f24282-d5dd-41ae-8131-846d8e8d53ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f24282-d5dd-41ae-8131-846d8e8d53ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e745db-755d-4f29-a8bf-a7ec8d24741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e745db-755d-4f29-a8bf-a7ec8d24741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7747e88b-3113-44f1-89b5-354ad2280880', 'volume_name': 'volume-7747e88b-3113-44f1-89b5-354ad2280880', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db5be1f-44cc-48b2-90dc-29fcf2e94d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db5be1f-44cc-48b2-90dc-29fcf2e94d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09df999-badc-46d2-b313-ae09964babf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 7747e88b-3113-44f1-89b5-354ad2280880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7747e88b-3113-44f1-89b5-354ad2280880', 'volume_size': 1} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:01 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1031297842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dafffa-787d-43c6-8088-86fd06694027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:01Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 73dafffa-787d-43c6-8088-86fd06694027 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:01 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d2bed5-dac9-4cf1-bda7-23f1d3b9a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e96546a-4562-49bd-aa94-ef6945296c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:01 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 1073741824 Sep 28 17:27:01 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:01 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Volume volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd (74e10cdf-9d2b-4161-a074-dc9c96fb7bdd): created successfully Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e96546a-4562-49bd-aa94-ef6945296c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:01 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (2c9a96c0-2127-44a0-9d8d-932ef2514a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4bce3db5-ae4d-411c-9913-ecfdf0908d27 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (225d5a2e-9b81-47b5-92d3-d4b39eef4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e311c5b-28ac-40a4-adc1-2fd0c49e7ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e311c5b-28ac-40a4-adc1-2fd0c49e7ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589795008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37806324-8984-422a-adfa-c7268aa4456a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:02Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280fa918-d082-40a0-a8a8-e7013b7a6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280fa918-d082-40a0-a8a8-e7013b7a6458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a33a47d-7028-4c35-98fe-a4bfb5d02aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a33a47d-7028-4c35-98fe-a4bfb5d02aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37806324-8984-422a-adfa-c7268aa4456a', 'volume_name': 'volume-37806324-8984-422a-adfa-c7268aa4456a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46deedbf-30fc-451f-9473-28cc43b59d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46deedbf-30fc-451f-9473-28cc43b59d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fd8901-09a4-475a-845f-dcdfe7ea1dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 37806324-8984-422a-adfa-c7268aa4456a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37806324-8984-422a-adfa-c7268aa4456a', 'volume_size': 1} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:02 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 1073741824" returned: 0 in 0.778s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:02 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 Sep 28 17:27:02 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (89592d0d-5889-42eb-b31e-1f06695b2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2ec3e-7208-45a0-800d-3c6acd8c071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2ec3e-7208-45a0-800d-3c6acd8c071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666248905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e68cea-27c8-41f9-b1be-6e0795546ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:02Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc7b5b9-41b5-4bb8-b59c-d92350375ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc7b5b9-41b5-4bb8-b59c-d92350375ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52df996-3235-4c81-95b0-8839c120bc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52df996-3235-4c81-95b0-8839c120bc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e68cea-27c8-41f9-b1be-6e0795546ae0', 'volume_name': 'volume-28e68cea-27c8-41f9-b1be-6e0795546ae0', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0f6e39-c75e-4f94-bbb0-959ab0be3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0f6e39-c75e-4f94-bbb0-959ab0be3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b5005a-220f-4f64-a521-02f895754319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 28e68cea-27c8-41f9-b1be-6e0795546ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e68cea-27c8-41f9-b1be-6e0795546ae0', 'volume_size': 1} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:02 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:02 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:02 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027" returned: 0 in 0.307s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854519069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747e88b-3113-44f1-89b5-354ad2280880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:01Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 7747e88b-3113-44f1-89b5-354ad2280880 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:02 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:02 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 1073741824 Sep 28 17:27:02 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c856726-af83-48c6-8de7-64f3a2ffc481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dafffa-787d-43c6-8088-86fd06694027', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b6dfe-436a-4a6d-87d8-99a54acad3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:02 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-73dafffa-787d-43c6-8088-86fd06694027 (73dafffa-787d-43c6-8088-86fd06694027): created successfully Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b6dfe-436a-4a6d-87d8-99a54acad3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (c32ee583-85ad-4362-b9eb-c417bb292676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:02 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9464b0dc-3895-448a-bbe8-39b0eba1776f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:27:03 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.338s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (cca646c5-08ee-4616-b8f7-76935357e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b76ae0-5acb-4be7-8406-7e9eff476ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b76ae0-5acb-4be7-8406-7e9eff476ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286960025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422acf3d-c760-4e3d-bee7-3eee1593a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:03Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6895a67e-06f4-4817-a4d8-5465fc8b3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6895a67e-06f4-4817-a4d8-5465fc8b3275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8265953a-0440-4f3b-93db-bf1a15dcdd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8265953a-0440-4f3b-93db-bf1a15dcdd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422acf3d-c760-4e3d-bee7-3eee1593a5fd', 'volume_name': 'volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac0ecd4-54c2-404d-aee8-2894125d08dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac0ecd4-54c2-404d-aee8-2894125d08dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c713d6cb-3a94-4d3d-8b91-cb7e113f9926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume 422acf3d-c760-4e3d-bee7-3eee1593a5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd', 'volume_size': 1} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:03 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 1073741824" returned: 0 in 0.564s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:03 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 Sep 28 17:27:03 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:03 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880" returned: 0 in 0.258s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.134s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Creating offline snapshot 9f76e56f-654c-4e7c-8d98-05888e31afab of volume e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09df999-badc-46d2-b313-ae09964babf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7747e88b-3113-44f1-89b5-354ad2280880', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e7d259-7a6f-4539-b5ce-201b9266479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f7567d-7ad8-4f40-aa65-0846e8957f94]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-7747e88b-3113-44f1-89b5-354ad2280880 (7747e88b-3113-44f1-89b5-354ad2280880): created successfully Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e7d259-7a6f-4539-b5ce-201b9266479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (70ccbcd7-df63-478f-8f6e-f3b06c0f7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-7e1fd794-4569-4f3b-b26b-3a52eb43cbe4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:27:03 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:03 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:04 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.482s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:04 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab 1G Sep 28 17:27:04 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:04 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab 1G" returned: 0 in 0.444s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99433b4-3ca3-45b5-b6af-77383301a950 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:04 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99433b4-3ca3-45b5-b6af-77383301a950 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e99433b4-3ca3-45b5-b6af-77383301a950 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.372s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:05 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab is being set with open permissions: ugo+rw Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:05 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.293s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info Sep 28 17:27:05 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info" returned: 0 in 0.319s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:05 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info is being set with open permissions: ugo+rw Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info Sep 28 17:27:05 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.info" returned: 0 in 0.282s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589795008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37806324-8984-422a-adfa-c7268aa4456a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:02Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 37806324-8984-422a-adfa-c7268aa4456a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:06 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a 1073741824 Sep 28 17:27:06 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b82df9d4-c918-4805-969a-689abc18c707 tempest-VolumeDependencyTests-299158267 None] Create snapshot completed successfully Sep 28 17:27:06 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a 1073741824" returned: 0 in 0.532s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a Sep 28 17:27:06 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:06 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.584s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Creating offline snapshot 76e558f7-ce1b-4633-8a4c-3fc3a29ca50d of volume 74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fd8901-09a4-475a-845f-dcdfe7ea1dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37806324-8984-422a-adfa-c7268aa4456a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490493dd-8dfe-4eac-91dd-fa4b3437ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f0dd3-6eb4-4c75-876b-9bd474c6a756]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-37806324-8984-422a-adfa-c7268aa4456a (37806324-8984-422a-adfa-c7268aa4456a): created successfully Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490493dd-8dfe-4eac-91dd-fa4b3437ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:06 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (225d5a2e-9b81-47b5-92d3-d4b39eef4758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-604082cc-a0c1-4214-9fd2-cc3426ff0e57 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:27:07 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd Sep 28 17:27:07 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:07 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" returned: 0 in 0.530s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:07 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d 1G Sep 28 17:27:07 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Flow 'volume_create_manager' (15913fbd-ba1b-44f3-8685-538feb460a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc9c8e-a2f9-4c29-8802-0b009138ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc9c8e-a2f9-4c29-8802-0b009138ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-259407021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16341cd2-dc36-4790-ac9a-44bdf937a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c08b026b36944c58ca05cf53d389a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f76e56f-654c-4e7c-8d98-05888e31afab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:08Z,use_quota=True,user_id='e84caff6dae0475db2c2de3d95243f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a605b4-d505-469a-bd46-8cefcefe6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a605b4-d505-469a-bd46-8cefcefe6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d7c324-1afe-457e-98b0-3dfc802f5383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d7c324-1afe-457e-98b0-3dfc802f5383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16341cd2-dc36-4790-ac9a-44bdf937a02c', 'volume_name': 'volume-16341cd2-dc36-4790-ac9a-44bdf937a02c', 'volume_size': 1, 'snapshot_id': '9f76e56f-654c-4e7c-8d98-05888e31afab'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3b196c-182d-4573-a8ea-ca346c3a12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3b196c-182d-4573-a8ea-ca346c3a12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb8df5d-2aed-4417-859d-ee6601ae294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:07 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Volume 16341cd2-dc36-4790-ac9a-44bdf937a02c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16341cd2-dc36-4790-ac9a-44bdf937a02c', 'volume_size': 1, 'snapshot_id': '9f76e56f-654c-4e7c-8d98-05888e31afab'} Sep 28 17:27:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:08 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d 1G" returned: 0 in 0.601s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d Sep 28 17:27:08 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" returned: 0 in 0.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d is being set with open permissions: ugo+rw Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d Sep 28 17:27:08 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" returned: 0 in 0.294s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info Sep 28 17:27:08 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info" returned: 0 in 0.297s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info is being set with open permissions: ugo+rw Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info Sep 28 17:27:09 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.info" returned: 0 in 0.278s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.727s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-666248905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e68cea-27c8-41f9-b1be-6e0795546ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:02Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 28e68cea-27c8-41f9-b1be-6e0795546ae0 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:09 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 1073741824 Sep 28 17:27:09 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c41fbcc9-dd5f-4244-8f95-279bf016259c tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot 76e558f7-ce1b-4633-8a4c-3fc3a29ca50d of volume 74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd140a3-5316-4ab9-a9f0-8169d4a37a14]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d Sep 28 17:27:09 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 1073741824" returned: 0 in 0.622s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 Sep 28 17:27:10 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" returned: 0 in 0.428s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c68e7-249f-48df-849f-72c68f93d97b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0" returned: 0 in 0.295s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.117s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286960025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422acf3d-c760-4e3d-bee7-3eee1593a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b1fda881c343b0bfb99a15cd5260e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:03Z,use_quota=True,user_id='94f73d129ac545a381d7fda88dccff4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Creating volume 422acf3d-c760-4e3d-bee7-3eee1593a5fd {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:10 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b5005a-220f-4f64-a521-02f895754319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e68cea-27c8-41f9-b1be-6e0795546ae0', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:10 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4ff800-3507-4c89-a9c1-1487619286aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:10 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd 1073741824 Sep 28 17:27:10 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 (28e68cea-27c8-41f9-b1be-6e0795546ae0): created successfully Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4ff800-3507-4c89-a9c1-1487619286aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (89592d0d-5889-42eb-b31e-1f06695b2f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d37b7ee9-e519-4b8d-83d7-b9096334cc33 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:27:10 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" returned: 0 in 0.466s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d Sep 28 17:27:10 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd 1073741824" returned: 0 in 0.636s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd Sep 28 17:27:11 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" returned: 0 in 0.482s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d Sep 28 17:27:11 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd" returned: 0 in 0.267s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.592s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab-16341cd2-dc36-4790-ac9a-44bdf937a02c" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c713d6cb-3a94-4d3d-8b91-cb7e113f9926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc94a8f-f369-468f-8463-2660958a7b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab-16341cd2-dc36-4790-ac9a-44bdf937a02c" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Creating volume 16341cd2-dc36-4790-ac9a-44bdf937a02c from snapshot 9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] snapshot: 9f76e56f-654c-4e7c-8d98-05888e31afab, volume: 16341cd2-dc36-4790-ac9a-44bdf937a02c, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348e61d-48b1-47a3-9f81-ee9cad341bf6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Volume volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd (422acf3d-c760-4e3d-bee7-3eee1593a5fd): created successfully Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc94a8f-f369-468f-8463-2660958a7b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Flow 'volume_create_manager' (cca646c5-08ee-4616-b8f7-76935357e804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd.76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" returned: 0 in 0.308s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d" released by "_delete_snapshot" :: held 1.842s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:11 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:11 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" released by "delete_snapshot" :: held 1.935s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:11 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ce36ca55-657c-47e2-ad09-32fda284e854 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created volume successfully. Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Created reservations ['13b51960-2c59-4ddc-b975-66e663bc5d05', '664554d5-c966-48fb-a4e4-110e040d6f59', '25836e87-03df-426e-9e7a-a3dd1aec2ced', '76208e66-8a59-4acd-99ff-8f7ee6607205'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:11 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99433b4-3ca3-45b5-b6af-77383301a950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c73d4c-7841-4f72-b2dc-d64b1b1ec777]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:12 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c08994eb-157a-405a-baf5-9d1977ae18bd tempest-ProjectMemberTests-510569012 None] Lock "cinder-76e558f7-ce1b-4633-8a4c-3fc3a29ca50d-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-422acf3d-c760-4e3d-bee7-3eee1593a5fd-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-422acf3d-c760-4e3d-bee7-3eee1593a5fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-422acf3d-c760-4e3d-bee7-3eee1593a5fd" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-422acf3d-c760-4e3d-bee7-3eee1593a5fd" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a270f24-b7e1-4e1f-98a5-c9e4c522cd46]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.491s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c Sep 28 17:27:12 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd Sep 28 17:27:12 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd" returned: 0 in 0.409s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd Sep 28 17:27:12 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:13 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-422acf3d-c760-4e3d-bee7-3eee1593a5fd" returned: 0 in 0.340s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-422acf3d-c760-4e3d-bee7-3eee1593a5fd" released by "delete_volume" :: held 0.818s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:14 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['a55c3df2-8fc2-4edb-9970-400b4b51440c', 'add6c817-2bd7-49e9-8376-c3d84fcb2868', 'e7535235-d382-4fa6-a988-881825e45be1', '79135200-aaba-46ed-b876-1038d7c87369'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "cinder-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce43381-7280-4a54-a05e-7013bded2e30]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:16 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd Sep 28 17:27:16 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:16 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:16 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:16 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" returned: 0 in 0.734s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:16 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.504s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:16 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:16 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:16 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd Sep 28 17:27:16 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:17 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" returned: 0 in 0.597s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:17 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd" released by "delete_volume" :: held 1.486s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Created reservations ['81b19452-af1c-4010-800a-c266ab19cc96', 'c7a1c2dd-929d-4f9d-b699-d7b696a46b62', 'f4cb716d-c35b-45de-95da-2a26a88679ca', 'e7386bec-2df4-4646-ac84-9684121519f2'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=161,cinder:UPDATE=218,cinder:INSERT=62,cinder:DELETE=19 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=199,cinder:SELECT=160,cinder:DELETE=22,cinder:INSERT=55 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b0ef311c-f9a7-448e-a781-d0229add535c tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-422acf3d-c760-4e3d-bee7-3eee1593a5fd-delete_volume" released by "delete_volume" :: held 5.929s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-28e68cea-27c8-41f9-b1be-6e0795546ae0-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-28e68cea-27c8-41f9-b1be-6e0795546ae0-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-28e68cea-27c8-41f9-b1be-6e0795546ae0" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-28e68cea-27c8-41f9-b1be-6e0795546ae0" acquired by "delete_volume" :: waited 0.085s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1de2fc2-da18-4d8f-976a-9fcd9b6dee76]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:18 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 Sep 28 17:27:18 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.527s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:27:19 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d6a2976e-f5f9-4a3b-a4fd-4a9c2e423950 tempest-ProjectMemberTests-510569012 None] Lock "cinder-74e10cdf-9d2b-4161-a074-dc9c96fb7bdd-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:19 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0" returned: 0 in 0.861s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:19 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0 Sep 28 17:27:19 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:20 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (c44c0118-d030-49bc-8627-6fca9a89698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833cdc39-3723-4924-ae1d-aed9f00f342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-28e68cea-27c8-41f9-b1be-6e0795546ae0" returned: 0 in 0.543s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833cdc39-3723-4924-ae1d-aed9f00f342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018295636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875b850e-1d33-4feb-bde9-9c0e87b6e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:20Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b2e6de-f417-4f8f-be52-8c3a662989af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b2e6de-f417-4f8f-be52-8c3a662989af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4c3dd-4bc2-411b-877c-2c89389a8938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4c3dd-4bc2-411b-877c-2c89389a8938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875b850e-1d33-4feb-bde9-9c0e87b6e610', 'volume_name': 'volume-875b850e-1d33-4feb-bde9-9c0e87b6e610', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073aebf0-d63f-4f05-a8f1-5497e3e52829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073aebf0-d63f-4f05-a8f1-5497e3e52829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3def38-3e25-4b01-aa89-487a18ea9247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Volume 875b850e-1d33-4feb-bde9-9c0e87b6e610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875b850e-1d33-4feb-bde9-9c0e87b6e610', 'volume_size': 1} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-28e68cea-27c8-41f9-b1be-6e0795546ae0" released by "delete_volume" :: held 1.657s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['549b1706-9d8b-494a-afff-64552f2856e4', 'e14263eb-ad51-4e1c-8f9a-2445c241e4e9', '618e4ed4-f0a7-4d1f-9829-662d551846fc', 'b660dda0-4694-4432-9c2b-41e7ccd02b0c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:20 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:20 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:20 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c" returned: 0 in 8.520s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950, size 1024.00 MB, duration 8.52 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:27:20 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Converted 1024.00 MB image at 120.15 MB/s Sep 28 17:27:20 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c is being set with open permissions: ugo+rw Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-37806324-8984-422a-adfa-c7268aa4456a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:20 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c Sep 28 17:27:20 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-37806324-8984-422a-adfa-c7268aa4456a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-37806324-8984-422a-adfa-c7268aa4456a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-37806324-8984-422a-adfa-c7268aa4456a" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:21 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.544s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3426fc67-fb79-45e9-abbc-95d6b8d27aa8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0864ea04-626e-4663-ba49-05e24ee5d122 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-28e68cea-27c8-41f9-b1be-6e0795546ae0-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:21 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a Sep 28 17:27:21 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c" returned: 0 in 0.389s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" released by "_copy_volume_from_snapshot" :: held 9.923s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab-16341cd2-dc36-4790-ac9a-44bdf937a02c" released by "_create_volume_from_snapshot" :: held 10.016s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.063s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018295636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=875b850e-1d33-4feb-bde9-9c0e87b6e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:20Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Creating volume 875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:21 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 1073741824 Sep 28 17:27:21 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb8df5d-2aed-4417-859d-ee6601ae294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16341cd2-dc36-4790-ac9a-44bdf937a02c', 'volume_size': 1, 'snapshot_id': '9f76e56f-654c-4e7c-8d98-05888e31afab'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce03c96-e091-439b-b0ca-c1a7bbb5d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:21 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Volume volume-16341cd2-dc36-4790-ac9a-44bdf937a02c (16341cd2-dc36-4790-ac9a-44bdf937a02c): created successfully Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce03c96-e091-439b-b0ca-c1a7bbb5d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Flow 'volume_create_manager' (15913fbd-ba1b-44f3-8685-538feb460a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-64bb3703-ee86-4965-bd2f-25c8e6cccdbe tempest-VolumeDependencyTests-299158267 None] Created volume successfully. Sep 28 17:27:21 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a" returned: 0 in 0.525s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a Sep 28 17:27:21 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-37806324-8984-422a-adfa-c7268aa4456a" returned: 0 in 0.321s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-37806324-8984-422a-adfa-c7268aa4456a" released by "delete_volume" :: held 0.928s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:22 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 1073741824" returned: 0 in 0.640s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-9f76e56f-654c-4e7c-8d98-05888e31afab-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['680e1660-2b14-454a-a413-b20fcbc10e81', '0bc9d8d1-5329-434d-885f-d52be8220aa2', '759fc730-1678-4e43-b9d7-1a477db3ee51', '712dd74b-e7d5-49a0-829b-669c9d28791f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-9f76e56f-654c-4e7c-8d98-05888e31afab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 Sep 28 17:27:22 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Deleting offline snapshot 9f76e56f-654c-4e7c-8d98-05888e31afab of volume e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] snapshot_file for this snap is: volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[128d2ffa-1d0b-4b24-af8c-dd900356ae90]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:22 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:22 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610" returned: 0 in 0.322s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3def38-3e25-4b01-aa89-487a18ea9247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875b850e-1d33-4feb-bde9-9c0e87b6e610', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c740f9ed-46cf-482e-b0cd-a2740194b0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Volume volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 (875b850e-1d33-4feb-bde9-9c0e87b6e610): created successfully Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c740f9ed-46cf-482e-b0cd-a2740194b0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (c44c0118-d030-49bc-8627-6fca9a89698a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-79f32f92-a772-49f9-ba44-732fbf521673 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:27:22 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.295s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:22 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-3392b59e-4a87-475c-a544-2ba0a5b1ba85 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-37806324-8984-422a-adfa-c7268aa4456a-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:22 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e99433b4-3ca3-45b5-b6af-77383301a950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[28727931-5c4b-4c7c-8900-8189e9a0dba4]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:22 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.625s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot f2f57efb-ac26-47d0-9545-8ae8447b8f70 of volume 875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:23 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:23 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-7747e88b-3113-44f1-89b5-354ad2280880-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd976b-cb1d-436c-85b6-ca38c141779c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-7747e88b-3113-44f1-89b5-354ad2280880-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-7747e88b-3113-44f1-89b5-354ad2280880" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-7747e88b-3113-44f1-89b5-354ad2280880" acquired by "delete_volume" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e266f-bb0a-46ea-980b-220d249f7355]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 Sep 28 17:27:23 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (fb151b23-3939-4d50-a5d4-438509471e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efaeccc-80b4-4f87-8122-4ea1fdd673f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efaeccc-80b4-4f87-8122-4ea1fdd673f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231065606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2db1e5-25e5-4c39-9f53-c46d63da6879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:24Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e0d3f-a625-4793-9784-cc3c9efb791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e0d3f-a625-4793-9784-cc3c9efb791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 Sep 28 17:27:23 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeb8149-cf1e-4c5b-b34f-be8b35b36919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeb8149-cf1e-4c5b-b34f-be8b35b36919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2db1e5-25e5-4c39-9f53-c46d63da6879', 'volume_name': 'volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e6daca-8282-4cd3-ad0c-525b59764a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e6daca-8282-4cd3-ad0c-525b59764a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d808c1-dcf4-4b83-94c7-d4f72eff8dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Volume ca2db1e5-25e5-4c39-9f53-c46d63da6879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879', 'volume_size': 1} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:23 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.470s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab Sep 28 17:27:23 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610" returned: 0 in 0.652s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950.9f76e56f-654c-4e7c-8d98-05888e31afab" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880" returned: 0 in 0.522s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 1G Sep 28 17:27:24 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880 Sep 28 17:27:24 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-9f76e56f-654c-4e7c-8d98-05888e31afab" released by "_delete_snapshot" :: held 2.016s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" released by "delete_snapshot" :: held 2.057s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Created reservations ['f0b877ca-c491-486a-af99-6aaa6e7cf8bf', 'ebe7c084-213a-4555-b74f-591a7c334709', 'c7f8fb62-98c3-4960-bae8-e14e5380f2bb', 'da6fd6ac-a73a-452c-9df7-98175d718855'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Delete snapshot completed successfully. Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ab1ccb9-a8b7-464b-bc5b-4dafe5177965 tempest-VolumeDependencyTests-299158267 None] Lock "cinder-9f76e56f-654c-4e7c-8d98-05888e31afab-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:24 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-7747e88b-3113-44f1-89b5-354ad2280880" returned: 0 in 0.377s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-7747e88b-3113-44f1-89b5-354ad2280880" released by "delete_volume" :: held 0.960s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['3939b838-e54a-4275-8c5d-c43e3c41d85a', 'fdd19fb0-6a2c-4adc-9cfa-7b8b4bd670ee', '80d2f149-f8e3-42e8-a5bc-a3129edae473', 'ed08eeb5-74a4-4fad-9a9b-c5990627dcf5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:24 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 1G" returned: 0 in 0.548s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 Sep 28 17:27:24 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:24 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.263s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:24 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70" returned: 0 in 0.322s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 is being set with open permissions: ugo+rw Sep 28 17:27:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 Sep 28 17:27:25 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2338c3d2-ccfa-44af-a1c0-13246be567e4 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-7747e88b-3113-44f1-89b5-354ad2280880-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:25 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70" returned: 0 in 0.294s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info Sep 28 17:27:25 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-e99433b4-3ca3-45b5-b6af-77383301a950-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "cinder-e99433b4-3ca3-45b5-b6af-77383301a950-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dba40-2aa0-4fba-971b-ac9a160902f3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info" returned: 0 in 0.287s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info is being set with open permissions: ugo+rw Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info Sep 28 17:27:25 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:25 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-73dafffa-787d-43c6-8088-86fd06694027-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-73dafffa-787d-43c6-8088-86fd06694027-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-73dafffa-787d-43c6-8088-86fd06694027" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-73dafffa-787d-43c6-8088-86fd06694027" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df38e22-2dc6-4a85-a80a-c501feb961f6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.info" returned: 0 in 0.345s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231065606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2db1e5-25e5-4c39-9f53-c46d63da6879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:24Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Creating volume ca2db1e5-25e5-4c39-9f53-c46d63da6879 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:26 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.446s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-24084b79-f458-4a79-81bc-93f06a377bf7 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:27:26 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 1073741824 Sep 28 17:27:26 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950 Sep 28 17:27:26 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 Sep 28 17:27:26 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-e99433b4-3ca3-45b5-b6af-77383301a950" returned: 0 in 0.273s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-e99433b4-3ca3-45b5-b6af-77383301a950" released by "delete_volume" :: held 0.798s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:26 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027" returned: 0 in 0.439s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027 Sep 28 17:27:26 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Created reservations ['46a5b866-5cbc-409a-85e2-40bd678c5238', 'ffe719df-0a7d-48ed-87ce-9398edfe0302', '279315bb-2901-4edf-8831-2644c7715732', 'ea6829c0-6e06-4306-99fe-8926f7b8d98c'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:26 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-f2f57efb-ac26-47d0-9545-8ae8447b8f70-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-16341cd2-dc36-4790-ac9a-44bdf937a02c-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 1073741824" returned: 0 in 0.753s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "cinder-16341cd2-dc36-4790-ac9a-44bdf937a02c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-f2f57efb-ac26-47d0-9545-8ae8447b8f70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.112s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-73dafffa-787d-43c6-8088-86fd06694027" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-f2f57efb-ac26-47d0-9545-8ae8447b8f70" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-73dafffa-787d-43c6-8088-86fd06694027" released by "delete_volume" :: held 0.972s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-f2f57efb-ac26-47d0-9545-8ae8447b8f70" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot f2f57efb-ac26-47d0-9545-8ae8447b8f70 of volume 875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:26 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Acquiring lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.374s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac6673-43e6-4dad-9f3b-7a85a57470d1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 Sep 28 17:27:26 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Deleted volume successfully. Sep 28 17:27:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" acquired by "delete_volume" :: waited 0.071s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d13174-95e2-4f60-830c-e97a466a49ab]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-818e67e6-2f54-4c8f-9edc-2e1e9d69c20f tempest-VolumeDependencyTests-299158267 None] Lock "cinder-e99433b4-3ca3-45b5-b6af-77383301a950-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['f08981fe-2653-42dd-95a5-3b489e7dd4e1', '49d37999-1ed5-40e2-a9ae-11c4ffbef2a3', 'b0c10b02-e9e3-4c34-8a06-f4507ba8fad2', 'a7af2198-ed87-4e92-82e8-5683a64e1e03'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:27 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 Sep 28 17:27:27 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:27 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:27 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:27 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879" returned: 0 in 0.352s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d808c1-dcf4-4b83-94c7-d4f72eff8dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02c988-549c-4106-8a7c-62047a24d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Volume volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 (ca2db1e5-25e5-4c39-9f53-c46d63da6879): created successfully Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a02c988-549c-4106-8a7c-62047a24d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (fb151b23-3939-4d50-a5d4-438509471e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-acffc501-32d0-4780-bc33-1e5fa7383c78 tempest-ProjectReaderTests-1493144730 None] Created volume successfully. Sep 28 17:27:27 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70" returned: 0 in 0.463s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-875b850e-1d33-4feb-bde9-9c0e87b6e610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0f413-ccc0-4b75-93e2-d550882c609a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c" returned: 0 in 0.491s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:27 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c Sep 28 17:27:27 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 Sep 28 17:27:27 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-213c8669-6a97-45a0-a15a-e5f6193a1356 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-73dafffa-787d-43c6-8088-86fd06694027-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-16341cd2-dc36-4790-ac9a-44bdf937a02c" returned: 0 in 0.294s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610" returned: 0 in 0.396s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "cinder-quobyte-16341cd2-dc36-4790-ac9a-44bdf937a02c" released by "delete_volume" :: held 0.878s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 Sep 28 17:27:27 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Created reservations ['f90f001a-3816-4250-ad04-fb5abb156622', 'e4b4fb89-1b94-48ac-aba9-cb2f7fdd1f79', 'dcf08b1d-891f-4804-9a7c-0101f49f782b', 'a94f4fe9-cdef-470f-b688-1dd3abda6f39'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:28 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-ca2db1e5-25e5-4c39-9f53-c46d63da6879-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-19f4ff84-2494-4964-a376-56a82523c2b1-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-19f4ff84-2494-4964-a376-56a82523c2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-ca2db1e5-25e5-4c39-9f53-c46d63da6879-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-19f4ff84-2494-4964-a376-56a82523c2b1" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-19f4ff84-2494-4964-a376-56a82523c2b1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleting offline snapshot 19f4ff84-2494-4964-a376-56a82523c2b1 of volume 3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] snapshot_file for this snap is: volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-quobyte-ca2db1e5-25e5-4c39-9f53-c46d63da6879" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b22437-4eb5-4ccf-aa1f-de81d875291d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-ca2db1e5-25e5-4c39-9f53-c46d63da6879" acquired by "delete_volume" :: waited 0.044s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70" returned: 0 in 0.512s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c26f946-9f4a-4fcf-8373-0a8ca95047de]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70 Sep 28 17:27:28 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.377s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Deleted volume successfully. Sep 28 17:27:28 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 Sep 28 17:27:28 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-a07366e9-0e29-4fcc-ac94-d08dea49311a tempest-VolumeDependencyTests-299158267 None] Lock "cinder-16341cd2-dc36-4790-ac9a-44bdf937a02c-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 Sep 28 17:27:28 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610.f2f57efb-ac26-47d0-9545-8ae8447b8f70" returned: 0 in 0.290s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-f2f57efb-ac26-47d0-9545-8ae8447b8f70" released by "_delete_snapshot" :: held 1.820s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" released by "delete_snapshot" :: held 1.869s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1" returned: 0 in 0.450s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d745752-ce34-4798-a157-8284d66fe253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d38f4e-1a2d-4d49-a43b-16096e57c2c9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Created reservations ['78b7e2d8-385f-4f8a-a564-1fe42e61fa54', 'c43751b0-751a-4c47-9ea6-8908d90c20e8', '2ce5ee25-fe03-45c2-82a8-3a5b6175c4a0', '230e0b4f-51fa-4cd9-8937-7d2c58cf78e6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:28 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879" returned: 0 in 0.478s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:27:28 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879 Sep 28 17:27:28 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c9bf3444-cb72-4d68-8401-168ccb35a9f3 tempest-ProjectMemberTests-510569012 None] Lock "cinder-f2f57efb-ac26-47d0-9545-8ae8447b8f70-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 Sep 28 17:27:28 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ca2db1e5-25e5-4c39-9f53-c46d63da6879" returned: 0 in 0.367s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-ca2db1e5-25e5-4c39-9f53-c46d63da6879" released by "delete_volume" :: held 0.913s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:29 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253" returned: 0 in 0.487s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 Sep 28 17:27:29 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Created reservations ['1cd99c09-d961-4648-a437-98c432ac95d3', '7fc1d545-d196-47bd-b0b5-c3feeaca1d95', 'ad086857-d669-4a60-95a8-506d3c58b04f', 'ad0bfe66-db47-483c-954e-94563fa9e1e7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:29 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1" returned: 0 in 0.421s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.287s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:29 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Deleted volume successfully. Sep 28 17:27:29 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1 Sep 28 17:27:29 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ecd7357-620c-4006-a9c8-6c7f6c44f0b3 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-ca2db1e5-25e5-4c39-9f53-c46d63da6879-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-875b850e-1d33-4feb-bde9-9c0e87b6e610-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "cinder-875b850e-1d33-4feb-bde9-9c0e87b6e610-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:30 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253.19f4ff84-2494-4964-a376-56a82523c2b1" returned: 0 in 0.327s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" acquired by "delete_volume" :: waited 0.060s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-19f4ff84-2494-4964-a376-56a82523c2b1" released by "_delete_snapshot" :: held 1.894s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" released by "delete_snapshot" :: held 1.945s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a2060-d4ac-42ae-baed-601421bb7f60]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['2aac7d7c-3421-44e1-8304-3edc2bdaae9b', '9d0ec9f5-638b-4247-be7c-99db1a914095', 'b1d1f5fb-c6dd-433b-a186-ac142404c0f0', 'a4cb2c35-585c-4461-af93-ecc2e6475b68'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:30 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 Sep 28 17:27:30 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Delete snapshot completed successfully. Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c6ae2356-db73-4fd1-98b0-09688ac46a5f tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-19f4ff84-2494-4964-a376-56a82523c2b1-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:30 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610" returned: 0 in 0.491s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610 Sep 28 17:27:30 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-875b850e-1d33-4feb-bde9-9c0e87b6e610" returned: 0 in 0.372s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-875b850e-1d33-4feb-bde9-9c0e87b6e610" released by "delete_volume" :: held 0.973s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (ff516433-26a3-4d87-b08f-0661c6d0288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5228b157-5704-4719-ba87-bc85ca3ce220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5228b157-5704-4719-ba87-bc85ca3ce220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357573589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c085da6-52fa-41f3-be56-9cd45bfd5f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:31Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ffb822-18c9-4ef7-a075-942e0094dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ffb822-18c9-4ef7-a075-942e0094dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2cf2-4a44-4757-b2a1-34df665315f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2cf2-4a44-4757-b2a1-34df665315f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c085da6-52fa-41f3-be56-9cd45bfd5f0b', 'volume_name': 'volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d151b05-8da5-4b41-a020-8c4a69cc9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d151b05-8da5-4b41-a020-8c4a69cc9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b99621-94e5-44f3-be82-30160244792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Volume 4c085da6-52fa-41f3-be56-9cd45bfd5f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b', 'volume_size': 1} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357573589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c085da6-52fa-41f3-be56-9cd45bfd5f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:31Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Creating volume 4c085da6-52fa-41f3-be56-9cd45bfd5f0b {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:31 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b 1073741824 Sep 28 17:27:31 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Created reservations ['cf9f4b21-63bd-42e4-ad5d-6acebbcb3ce4', '9fe6b0e6-ed94-404c-beea-e423a80f3c63', 'caf80286-67b1-47ab-a31f-71640fe54566', '59d3e5e2-d266-4361-a6fa-11ae2698a9f4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-3d745752-ce34-4798-a157-8284d66fe253-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:31 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:31 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-3d745752-ce34-4798-a157-8284d66fe253-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" acquired by "delete_volume" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893e010-e1c6-4fde-91ef-526eead9c3ae]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.354s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:27:31 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 Sep 28 17:27:31 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-2e6012c0-3809-4c9e-a60b-a5d1a2f254d4 tempest-ProjectMemberTests-510569012 None] Lock "cinder-875b850e-1d33-4feb-bde9-9c0e87b6e610-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:31 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b 1073741824" returned: 0 in 0.691s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b Sep 28 17:27:32 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253" returned: 0 in 0.484s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253 Sep 28 17:27:32 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" returned: 0 in 0.288s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b99621-94e5-44f3-be82-30160244792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe61639-63aa-4293-b174-0303d287a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:32 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Volume volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b (4c085da6-52fa-41f3-be56-9cd45bfd5f0b): created successfully Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe61639-63aa-4293-b174-0303d287a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (ff516433-26a3-4d87-b08f-0661c6d0288c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-84600e9b-226b-46f4-b43b-d6d14e640fd2 tempest-ProjectReaderTests-1493144730 None] Created volume successfully. Sep 28 17:27:32 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3d745752-ce34-4798-a157-8284d66fe253" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-quobyte-3d745752-ce34-4798-a157-8284d66fe253" released by "delete_volume" :: held 0.894s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Created reservations ['78e1ee68-6980-424f-96bf-90820c3d3d8d', 'c371a6c8-dd95-4a0c-9ab7-8ab83909f5a0', '49444053-b954-42c7-a544-014bfe7da24b', '23819144-45ff-482d-b854-e4592dc25bb3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:32 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.371s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (ffc691c8-4b23-4b40-b807-410fe67d04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a8afb3-a22e-4024-8098-63edea9b52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Deleted volume successfully. Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a8afb3-a22e-4024-8098-63edea9b52d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271761130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062098bb-e10d-400c-87c9-8b292647041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:33Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd1996d-c132-4dcd-85a2-09f87e1dbcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd1996d-c132-4dcd-85a2-09f87e1dbcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34508dd1-4ef7-4b12-bd34-fff5c8b993b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34508dd1-4ef7-4b12-bd34-fff5c8b993b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062098bb-e10d-400c-87c9-8b292647041d', 'volume_name': 'volume-062098bb-e10d-400c-87c9-8b292647041d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee6423f-5ec1-4bab-a053-6064e9e1f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee6423f-5ec1-4bab-a053-6064e9e1f723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ea92fa-1fd9-4b62-a23b-9017b61aa67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Volume 062098bb-e10d-400c-87c9-8b292647041d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062098bb-e10d-400c-87c9-8b292647041d', 'volume_size': 1} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271761130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062098bb-e10d-400c-87c9-8b292647041d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:33Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Creating volume 062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:33 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b2c70349-73c2-4080-9f1e-cd16be6cdec1 tempest-CreateVolumesFromSnapshotTest-2089149072 None] Lock "cinder-3d745752-ce34-4798-a157-8284d66fe253-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:33 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d 1073741824 Sep 28 17:27:33 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-4c085da6-52fa-41f3-be56-9cd45bfd5f0b-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-4c085da6-52fa-41f3-be56-9cd45bfd5f0b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-quobyte-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" acquired by "delete_volume" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3979d5-b412-4a8c-b8d6-c87418ed4770]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b Sep 28 17:27:33 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:33 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d 1073741824" returned: 0 in 0.682s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:33 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" returned: 0 in 0.489s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b Sep 28 17:27:33 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d Sep 28 17:27:34 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:34 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ea92fa-1fd9-4b62-a23b-9017b61aa67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062098bb-e10d-400c-87c9-8b292647041d', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b4c2da-9bc6-4cb6-ac23-63857789cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-4c085da6-52fa-41f3-be56-9cd45bfd5f0b" released by "delete_volume" :: held 0.994s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Volume volume-062098bb-e10d-400c-87c9-8b292647041d (062098bb-e10d-400c-87c9-8b292647041d): created successfully Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b4c2da-9bc6-4cb6-ac23-63857789cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (ffc691c8-4b23-4b40-b807-410fe67d04f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-19f9f3c6-5f7f-431e-a17c-f666727eb3fa tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Created reservations ['8883400f-4de2-4b43-8ed0-b486335f053b', '636ce464-b73e-4ca8-85e1-abf38e49358b', '35af7ad5-b9f3-41ae-a1c9-c22901afb35e', 'bfd6c15c-88aa-4785-91bf-8eb6e00a17f3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:34 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (137ade53-78d2-46f3-bcea-ad7889024450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc81d6c-6a7a-41dc-9d11-4e4dc70fd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc81d6c-6a7a-41dc-9d11-4e4dc70fd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44925126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c121df18-e427-4cf3-9c4c-fdb3a806acf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:35Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c556d0-6b08-4172-94f8-9ce05bc96164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c556d0-6b08-4172-94f8-9ce05bc96164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645207e5-2785-481e-97ce-0e618047ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645207e5-2785-481e-97ce-0e618047ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c121df18-e427-4cf3-9c4c-fdb3a806acf3', 'volume_name': 'volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a4912f-2e48-4e38-91d5-bee8f6589f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a4912f-2e48-4e38-91d5-bee8f6589f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56c01c1-8034-4749-b1ff-20bae0ba68bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Volume c121df18-e427-4cf3-9c4c-fdb3a806acf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3', 'volume_size': 1} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44925126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c121df18-e427-4cf3-9c4c-fdb3a806acf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:35Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Creating volume c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:34 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 1073741824 Sep 28 17:27:34 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.313s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:34 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Deleted volume successfully. Sep 28 17:27:34 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0db9d4a7-f54a-4eca-bc4f-fe1cda880442 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-4c085da6-52fa-41f3-be56-9cd45bfd5f0b-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:35 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 1073741824" returned: 0 in 0.594s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 Sep 28 17:27:35 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3" returned: 0 in 0.283s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56c01c1-8034-4749-b1ff-20bae0ba68bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211d36ae-1937-409f-9e77-b719858d50bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot d287b32f-1451-45d4-82a2-79f137ca579f of volume 062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:35 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Volume volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 (c121df18-e427-4cf3-9c4c-fdb3a806acf3): created successfully Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211d36ae-1937-409f-9e77-b719858d50bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (137ade53-78d2-46f3-bcea-ad7889024450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31035b-d41f-4e22-9a31-1a04d9708182]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:35 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-17ab5d41-0f37-4267-9811-3c34ab3671d6 tempest-ProjectReaderTests-1351242153 None] Created volume successfully. Sep 28 17:27:35 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d Sep 28 17:27:35 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (3e5aa8e0-2276-4e24-997f-d45536833136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1db1b84-e97b-4f68-a173-06bb15b73667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1db1b84-e97b-4f68-a173-06bb15b73667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614913563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2142b2bd-7bfb-4111-b575-dbdc5bcbf61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:36Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f34c17-f410-46a3-8353-edb3273ec464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f34c17-f410-46a3-8353-edb3273ec464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492452de-dbac-4bb6-b5fc-a08f119ec172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492452de-dbac-4bb6-b5fc-a08f119ec172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2142b2bd-7bfb-4111-b575-dbdc5bcbf61e', 'volume_name': 'volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdf44cb-4d94-48de-99e1-e78252ceb6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdf44cb-4d94-48de-99e1-e78252ceb6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06a4693-3d19-43b7-9dca-74c0fce71c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Volume 2142b2bd-7bfb-4111-b575-dbdc5bcbf61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e', 'volume_size': 1} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:36 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d" returned: 0 in 0.442s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f 1G Sep 28 17:27:36 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Flow 'volume_create_manager' (0e970779-4e25-4c38-a313-83415c73bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a63a69-527f-43ab-bc9c-7a3b01feff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f 1G" returned: 0 in 0.582s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062098bb-e10d-400c-87c9-8b292647041d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a63a69-527f-43ab-bc9c-7a3b01feff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db153c5-b49a-4b31-87c8-6040517e32be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caf22dbaf474b4da417df396a6bdcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:37Z,use_quota=True,user_id='112819d799214be497a09bc82411de61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062098bb-e10d-400c-87c9-8b292647041d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f Sep 28 17:27:36 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cb9e4f-56db-43b6-8dbb-dcfa2a423793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cb9e4f-56db-43b6-8dbb-dcfa2a423793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6266aba1-c18e-452a-ab03-f1e1536572bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6266aba1-c18e-452a-ab03-f1e1536572bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db153c5-b49a-4b31-87c8-6040517e32be', 'volume_name': 'volume-5db153c5-b49a-4b31-87c8-6040517e32be', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a672f3fd-b9f4-411c-bf15-7000b589b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a672f3fd-b9f4-411c-bf15-7000b589b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618df0c3-f1b1-49e8-aea2-1ffc0a51a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:36 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Volume 5db153c5-b49a-4b31-87c8-6040517e32be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db153c5-b49a-4b31-87c8-6040517e32be', 'volume_size': 1} Sep 28 17:27:36 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:37 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062098bb-e10d-400c-87c9-8b292647041d -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f" returned: 0 in 0.314s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f is being set with open permissions: ugo+rw Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f Sep 28 17:27:37 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f" returned: 0 in 0.246s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info Sep 28 17:27:37 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info" returned: 0 in 0.245s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info is being set with open permissions: ugo+rw Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info Sep 28 17:27:37 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.info" returned: 0 in 0.234s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614913563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2142b2bd-7bfb-4111-b575-dbdc5bcbf61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:36Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Creating volume 2142b2bd-7bfb-4111-b575-dbdc5bcbf61e {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:37 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:37 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:38 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e 1073741824 Sep 28 17:27:38 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-29117d79-6391-42ba-9302-48dc8687a187 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:27:38 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e 1073741824" returned: 0 in 0.457s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-d287b32f-1451-45d4-82a2-79f137ca579f-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-d287b32f-1451-45d4-82a2-79f137ca579f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-d287b32f-1451-45d4-82a2-79f137ca579f" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e Sep 28 17:27:38 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-d287b32f-1451-45d4-82a2-79f137ca579f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot d287b32f-1451-45d4-82a2-79f137ca579f of volume 062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33706c-595a-464b-869e-6484adfd0f77]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:38 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f Sep 28 17:27:38 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" returned: 0 in 0.261s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db153c5-b49a-4b31-87c8-6040517e32be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caf22dbaf474b4da417df396a6bdcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:37Z,use_quota=True,user_id='112819d799214be497a09bc82411de61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Creating volume 5db153c5-b49a-4b31-87c8-6040517e32be {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:38 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06a4693-3d19-43b7-9dca-74c0fce71c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e723648-9739-4640-aed9-eb5883e98701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be 1073741824 Sep 28 17:27:38 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Volume volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e (2142b2bd-7bfb-4111-b575-dbdc5bcbf61e): created successfully Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e723648-9739-4640-aed9-eb5883e98701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (3e5aa8e0-2276-4e24-997f-d45536833136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:38 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-11ad9ef0-6d2c-4bd2-bc2e-bc018d2a39ce tempest-ProjectReaderTests-1493144730 None] Created volume successfully. Sep 28 17:27:39 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f" returned: 0 in 0.434s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-062098bb-e10d-400c-87c9-8b292647041d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[375b53f8-c59a-43fb-9d2f-651209e4b774]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d Sep 28 17:27:39 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be 1073741824" returned: 0 in 0.519s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be Sep 28 17:27:39 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-quobyte-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed0494-1cc0-4cea-b5de-ea1ce3f97bdd]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d" returned: 0 in 0.456s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f Sep 28 17:27:39 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e Sep 28 17:27:39 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.679s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618df0c3-f1b1-49e8-aea2-1ffc0a51a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db153c5-b49a-4b31-87c8-6040517e32be', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1394d-7b53-4768-a4d4-a1bbda1f2f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Creating offline snapshot d175bedd-2d53-4c52-85c6-7f02179eabf8 of volume c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:39 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Volume volume-5db153c5-b49a-4b31-87c8-6040517e32be (5db153c5-b49a-4b31-87c8-6040517e32be): created successfully Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1394d-7b53-4768-a4d4-a1bbda1f2f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Flow 'volume_create_manager' (0e970779-4e25-4c38-a313-83415c73bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff25ae7-4e72-412a-9043-58ed1d7aad9d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-902f8292-b093-48c3-aacc-2a5ae988cf25 tempest-CinderUnicodeTest-1564265164 None] Created volume successfully. Sep 28 17:27:39 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 Sep 28 17:27:39 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f" returned: 0 in 0.414s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" returned: 0 in 0.464s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f Sep 28 17:27:39 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e Sep 28 17:27:39 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d.d287b32f-1451-45d4-82a2-79f137ca579f" returned: 0 in 0.295s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-d287b32f-1451-45d4-82a2-79f137ca579f" released by "_delete_snapshot" :: held 1.737s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3" returned: 0 in 0.521s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" released by "delete_snapshot" :: held 1.785s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" returned: 0 in 0.364s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 1G Sep 28 17:27:40 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e" released by "delete_volume" :: held 0.893s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Created reservations ['f879f34d-550e-4b55-abf2-76cab8237545', 'bfe066df-69c6-4573-bf17-fa64b8870250', '43a94347-78ec-4ba4-b012-4a5cf6df66e1', '614f9b56-41d4-471f-a3b0-6e8866e35bc6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Created reservations ['2aad96fe-eae7-4750-914b-be1032dc1f81', '0fc48a02-bafb-4384-8071-33f3470b2819', 'bd47ea8d-41b9-4d14-8444-89c56931f13b', '1de4d8db-3a51-4288-9822-3ed491e8a2fc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:40 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aae60d9d-35c0-4016-bbd3-72f11803a66a tempest-ProjectMemberTests-510569012 None] Lock "cinder-d287b32f-1451-45d4-82a2-79f137ca579f-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-062098bb-e10d-400c-87c9-8b292647041d-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:40 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "cinder-062098bb-e10d-400c-87c9-8b292647041d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Flow 'volume_create_manager' (a0dd5a09-28df-4613-bb90-c99ef4ad129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a746e35-4405-4d31-a3d5-9d9bd6be03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a746e35-4405-4d31-a3d5-9d9bd6be03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1544887912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7ec9ac-55d5-4129-886d-705e5461e5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caf22dbaf474b4da417df396a6bdcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:41Z,use_quota=True,user_id='112819d799214be497a09bc82411de61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5727cd-884b-429a-be69-8918fc42b7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5727cd-884b-429a-be69-8918fc42b7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8de5e-9ff4-4c69-b436-69db94a7ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8de5e-9ff4-4c69-b436-69db94a7ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7ec9ac-55d5-4129-886d-705e5461e5d3', 'volume_name': 'volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abeb8a2a-715a-4968-8ab9-95cb7f5e41b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abeb8a2a-715a-4968-8ab9-95cb7f5e41b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91ec3ca-f243-4683-b107-ee3ffa588c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:40 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Volume 8f7ec9ac-55d5-4129-886d-705e5461e5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3', 'volume_size': 1} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:40 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 1G" returned: 0 in 0.629s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:40 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 Sep 28 17:27:40 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:41 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.355s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ed71e-7e66-424f-9a80-f379d9cffccf]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:41 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Deleted volume successfully. Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-bdae64e1-ccd0-4353-a684-1f779091e057 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-2142b2bd-7bfb-4111-b575-dbdc5bcbf61e-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:41 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d Sep 28 17:27:41 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8" returned: 0 in 0.359s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 is being set with open permissions: ugo+rw Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 Sep 28 17:27:41 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d" returned: 0 in 0.408s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d Sep 28 17:27:41 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8" returned: 0 in 0.287s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info Sep 28 17:27:41 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-062098bb-e10d-400c-87c9-8b292647041d" returned: 0 in 0.279s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-062098bb-e10d-400c-87c9-8b292647041d" released by "delete_volume" :: held 0.787s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Created reservations ['f71e51c1-ae8e-47b9-8579-074987a4cf9c', '4f179af2-ceaf-4198-a446-232a24488dbd', '767ba6f8-078a-4574-95bf-4cd6ee2c9a3c', 'a4ade15c-5b85-4778-922e-b40a31aa929a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info" returned: 0 in 0.331s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info is being set with open permissions: ugo+rw Sep 28 17:27:41 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:41 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info Sep 28 17:27:42 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:42 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.338s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:27:42 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (e222aa79-29cb-4ed8-a592-5401bc991919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a1013-8497-43ba-812b-a854e4d10ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-6ffe7ade-0912-445e-881e-6751fffff029 tempest-ProjectMemberTests-510569012 None] Lock "cinder-062098bb-e10d-400c-87c9-8b292647041d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.info" returned: 0 in 0.400s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1544887912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7ec9ac-55d5-4129-886d-705e5461e5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3caf22dbaf474b4da417df396a6bdcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:41Z,use_quota=True,user_id='112819d799214be497a09bc82411de61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Creating volume 8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:42 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8a1013-8497-43ba-812b-a854e4d10ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159783615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f67fc31-6c66-4d04-b484-01f2d1510533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:42Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 1073741824 Sep 28 17:27:42 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e3c6ac-a8fb-4d5e-a51f-761c2cc4645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e3c6ac-a8fb-4d5e-a51f-761c2cc4645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788c8428-2726-4193-8acf-2cef3915b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788c8428-2726-4193-8acf-2cef3915b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f67fc31-6c66-4d04-b484-01f2d1510533', 'volume_name': 'volume-5f67fc31-6c66-4d04-b484-01f2d1510533', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f1105-d527-4a25-b593-e757c9a45909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f1105-d527-4a25-b593-e757c9a45909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6363381b-e8a9-44c6-8878-840af389de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Volume 5f67fc31-6c66-4d04-b484-01f2d1510533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f67fc31-6c66-4d04-b484-01f2d1510533', 'volume_size': 1} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ea055c8b-4090-4aab-8a08-5c63456e4de9 tempest-ProjectReaderTests-1351242153 None] Create snapshot completed successfully Sep 28 17:27:42 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 1073741824" returned: 0 in 0.540s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 Sep 28 17:27:43 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3" returned: 0 in 0.310s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159783615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f67fc31-6c66-4d04-b484-01f2d1510533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9e2a301f6548a9ab9cb8eabdb28aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:42Z,use_quota=True,user_id='831f221e8c1c4b3d989025d577e1f8a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Creating volume 5f67fc31-6c66-4d04-b484-01f2d1510533 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:43 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91ec3ca-f243-4683-b107-ee3ffa588c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fb4707-882e-4082-b236-4e9d014c371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 1073741824 Sep 28 17:27:43 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Volume volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 (8f7ec9ac-55d5-4129-886d-705e5461e5d3): created successfully Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fb4707-882e-4082-b236-4e9d014c371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Flow 'volume_create_manager' (a0dd5a09-28df-4613-bb90-c99ef4ad129a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-68527508-9237-4e48-814e-a3d936d50762 tempest-CinderUnicodeTest-1564265164 None] Created volume successfully. Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (974f2be7-beef-4ace-a952-0c2c50ab4b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d118967-bc04-431b-86b1-01afd0cd546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-d175bedd-2d53-4c52-85c6-7f02179eabf8-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d118967-bc04-431b-86b1-01afd0cd546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846286559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b65d94-080d-4367-950c-74f8d3d0e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:44Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03365dd-2793-402b-b57d-469b3773eae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03365dd-2793-402b-b57d-469b3773eae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa92f6a-d387-46a6-bcbc-ef4d1c1ef8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa92f6a-d387-46a6-bcbc-ef4d1c1ef8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b65d94-080d-4367-950c-74f8d3d0e952', 'volume_name': 'volume-39b65d94-080d-4367-950c-74f8d3d0e952', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69654eac-da41-4210-9fc5-dd1e0e836549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69654eac-da41-4210-9fc5-dd1e0e836549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b3c9e1-dd93-403e-b80d-2069bd5b750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Volume 39b65d94-080d-4367-950c-74f8d3d0e952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b65d94-080d-4367-950c-74f8d3d0e952', 'volume_size': 1} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-d175bedd-2d53-4c52-85c6-7f02179eabf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-d175bedd-2d53-4c52-85c6-7f02179eabf8" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-d175bedd-2d53-4c52-85c6-7f02179eabf8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Deleting offline snapshot d175bedd-2d53-4c52-85c6-7f02179eabf8 of volume c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] snapshot_file for this snap is: volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3411fe5-14e9-4c6d-8564-6902eb35f36f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 1073741824" returned: 0 in 0.589s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 Sep 28 17:27:43 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 Sep 28 17:27:43 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:44 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8" returned: 0 in 0.424s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:44 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533" returned: 0 in 0.300s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846286559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b65d94-080d-4367-950c-74f8d3d0e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:44Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Creating volume 39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:44 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c504b421-cea0-4780-aca9-7a8a8d540d89]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 1073741824 Sep 28 17:27:44 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6363381b-e8a9-44c6-8878-840af389de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f67fc31-6c66-4d04-b484-01f2d1510533', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48207e72-3976-4950-9641-ca15acacdeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:44 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Volume volume-5f67fc31-6c66-4d04-b484-01f2d1510533 (5f67fc31-6c66-4d04-b484-01f2d1510533): created successfully Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48207e72-3976-4950-9641-ca15acacdeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Flow 'volume_create_manager' (e222aa79-29cb-4ed8-a592-5401bc991919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:44 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e3338902-f4d4-4b1c-9a77-d38dd75b0aac tempest-ProjectReaderTests-1493144730 None] Created volume successfully. Sep 28 17:27:44 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 Sep 28 17:27:44 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3" returned: 0 in 0.410s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 Sep 28 17:27:44 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 1073741824" returned: 0 in 0.470s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 Sep 28 17:27:44 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952" returned: 0 in 0.265s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:45 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.920s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8" returned: 0 in 0.377s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b3c9e1-dd93-403e-b80d-2069bd5b750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b65d94-080d-4367-950c-74f8d3d0e952', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92946e79-f1c8-49e0-b52b-37da67e58677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:45 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8 Sep 28 17:27:45 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Creating offline snapshot 3e628f21-f736-4180-b00d-7441279d9a36 of volume 8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:45 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Volume volume-39b65d94-080d-4367-950c-74f8d3d0e952 (39b65d94-080d-4367-950c-74f8d3d0e952): created successfully Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92946e79-f1c8-49e0-b52b-37da67e58677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (974f2be7-beef-4ace-a952-0c2c50ab4b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c62abee-2ddd-47ff-9c3c-7234ce8eaaa8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-68f78c9c-0d31-4711-9efc-33fea3f550c9 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:27:45 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 Sep 28 17:27:45 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3.d175bedd-2d53-4c52-85c6-7f02179eabf8" returned: 0 in 0.249s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-d175bedd-2d53-4c52-85c6-7f02179eabf8" released by "_delete_snapshot" :: held 1.601s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" released by "delete_snapshot" :: held 1.625s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Created reservations ['ce8b886d-9aff-4cc0-8c9f-5dbcd54ac4ab', '944ddcaf-555e-4664-8c9a-ce346341b2ff', 'eca4da69-77ca-410a-8222-bb13e8fabc02', '2f7756a9-9d5c-487d-b65b-a96d7ac3b664'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:45 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Delete snapshot completed successfully. Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1a5cd5dc-0f0a-4efe-ac9a-cdab4b4b6de5 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-d175bedd-2d53-4c52-85c6-7f02179eabf8-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:45 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-5f67fc31-6c66-4d04-b484-01f2d1510533-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3" returned: 0 in 0.451s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-5f67fc31-6c66-4d04-b484-01f2d1510533-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 1G Sep 28 17:27:45 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "cinder-quobyte-5f67fc31-6c66-4d04-b484-01f2d1510533" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-5f67fc31-6c66-4d04-b484-01f2d1510533" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[91504a2c-8d24-4db4-83a3-a42bd98800f8]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-c121df18-e427-4cf3-9c4c-fdb3a806acf3-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "cinder-c121df18-e427-4cf3-9c4c-fdb3a806acf3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:45 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 Sep 28 17:27:45 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" acquired by "delete_volume" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edf28a6-fd31-40b8-87b0-ad2a50845252]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:45 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 Sep 28 17:27:46 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 1G" returned: 0 in 0.548s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 Sep 28 17:27:46 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533" returned: 0 in 0.492s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533 Sep 28 17:27:46 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3" returned: 0 in 0.454s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3 Sep 28 17:27:46 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36" returned: 0 in 0.324s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 is being set with open permissions: ugo+rw Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 Sep 28 17:27:46 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5f67fc31-6c66-4d04-b484-01f2d1510533" returned: 0 in 0.268s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-quobyte-5f67fc31-6c66-4d04-b484-01f2d1510533" released by "delete_volume" :: held 0.820s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Created reservations ['542cfc1e-fbb9-4247-ac5e-945ed46c2cbe', '56fdb116-4cf4-4818-8335-294297c1720f', 'f4ee2498-ec14-4ef0-89ca-921237a013c8', '41671576-34d9-4689-82f0-a1ad68f755a4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:46 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c121df18-e427-4cf3-9c4c-fdb3a806acf3" returned: 0 in 0.279s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c121df18-e427-4cf3-9c4c-fdb3a806acf3" released by "delete_volume" :: held 0.805s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:46 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36" returned: 0 in 0.296s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Created reservations ['fe6b9bb5-ccc3-4ff2-a3e8-1d65b6978b88', 'ace209fb-5226-4c13-8a93-e0eb9aaf4b18', '29a9a407-2fa4-47ca-a379-b6114dc1d4b8', '64af77e4-fd96-44c4-9677-7e2e83ccdebf'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:46 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info Sep 28 17:27:46 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:46 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:47 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Deleted volume successfully. Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9ea92684-a194-4c05-ba6b-85f7c1cd8019 tempest-ProjectReaderTests-1493144730 None] Lock "cinder-5f67fc31-6c66-4d04-b484-01f2d1510533-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:47 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info" returned: 0 in 0.359s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info is being set with open permissions: ugo+rw Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info Sep 28 17:27:47 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.368s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Deleted volume successfully. Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-ee5dd409-1b02-4689-9cd9-165a7911057c tempest-ProjectReaderTests-1351242153 None] Lock "cinder-c121df18-e427-4cf3-9c4c-fdb3a806acf3-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:47 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.info" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.667s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot fc2471e3-3b65-4f61-a2a2-1489474b5e8a of volume 39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc32b331-529e-4a5c-b158-dcce9ac6cd1d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-dda048a3-044f-43e1-8e26-b328fad4ca3f tempest-CinderUnicodeTest-1564265164 None] Create snapshot completed successfully Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (22e19aa0-c8de-4857-8088-62f42b5e001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702758a-026d-40a0-b3ac-b36a4e37741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702758a-026d-40a0-b3ac-b36a4e37741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177085077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a92d7-8562-4a93-a4b0-0e41371fa868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:48Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7512ecb9-b181-4d4e-8a8f-12b9fd7d9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7512ecb9-b181-4d4e-8a8f-12b9fd7d9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b1ccf8-2333-4e50-8e0e-1f1ec4c752f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b1ccf8-2333-4e50-8e0e-1f1ec4c752f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15a92d7-8562-4a93-a4b0-0e41371fa868', 'volume_name': 'volume-c15a92d7-8562-4a93-a4b0-0e41371fa868', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1de239-4004-468e-95af-c328d4682dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1de239-4004-468e-95af-c328d4682dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0254bb0-1388-42c7-8497-9d62fe0428fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Volume c15a92d7-8562-4a93-a4b0-0e41371fa868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15a92d7-8562-4a93-a4b0-0e41371fa868', 'volume_size': 1} Sep 28 17:27:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:47 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 Sep 28 17:27:47 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:48 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a 1G Sep 28 17:27:48 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-3e628f21-f736-4180-b00d-7441279d9a36-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-3e628f21-f736-4180-b00d-7441279d9a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-quobyte-3e628f21-f736-4180-b00d-7441279d9a36" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-3e628f21-f736-4180-b00d-7441279d9a36" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Deleting offline snapshot 3e628f21-f736-4180-b00d-7441279d9a36 of volume 8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] snapshot_file for this snap is: volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8227057-04cb-44d6-ab57-ab3494557b4e]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:48 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a 1G" returned: 0 in 0.578s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:48 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b65d94-080d-4367-950c-74f8d3d0e952 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:48 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b65d94-080d-4367-950c-74f8d3d0e952 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a Sep 28 17:27:48 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 Sep 28 17:27:48 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36" returned: 0 in 0.408s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b65d94-080d-4367-950c-74f8d3d0e952 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a" returned: 0 in 0.376s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a is being set with open permissions: ugo+rw Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29a392-6084-4721-ad94-f75b02de38de]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a Sep 28 17:27:49 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 Sep 28 17:27:49 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a" returned: 0 in 0.257s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info Sep 28 17:27:49 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3" returned: 0 in 0.451s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 Sep 28 17:27:49 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info" returned: 0 in 0.282s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info is being set with open permissions: ugo+rw Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info Sep 28 17:27:49 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.info" returned: 0 in 0.247s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177085077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15a92d7-8562-4a93-a4b0-0e41371fa868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:48Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Creating volume c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:49 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36" returned: 0 in 0.390s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 1073741824 Sep 28 17:27:49 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36 Sep 28 17:27:49 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e4e1bfff-5960-4fb8-b713-502a2f598eb1 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-fc2471e3-3b65-4f61-a2a2-1489474b5e8a-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-fc2471e3-3b65-4f61-a2a2-1489474b5e8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-fc2471e3-3b65-4f61-a2a2-1489474b5e8a" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:50 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-fc2471e3-3b65-4f61-a2a2-1489474b5e8a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot fc2471e3-3b65-4f61-a2a2-1489474b5e8a of volume 39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3.3e628f21-f736-4180-b00d-7441279d9a36" returned: 0 in 0.353s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37aae01-cdc1-42e2-a6fe-196a391e9fce]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-3e628f21-f736-4180-b00d-7441279d9a36" released by "_delete_snapshot" :: held 1.754s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" released by "delete_snapshot" :: held 1.787s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:50 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 1073741824" returned: 0 in 0.514s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Created reservations ['e75f3723-6b78-4d14-94fc-8855e99e96aa', '5c76d32c-dc75-4469-9170-5b3b869391e3', 'f99f92a0-c810-4004-84ac-3c0033ac6dbc', '70b9c386-08e8-44e8-b503-ce09002db8b1'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:50 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a Sep 28 17:27:50 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 Sep 28 17:27:50 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Delete snapshot completed successfully. Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-b6364c85-53d0-4731-abcf-effc46250377 tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-3e628f21-f736-4180-b00d-7441279d9a36-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-8f7ec9ac-55d5-4129-886d-705e5461e5d3-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:50 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39b65d94-080d-4367-950c-74f8d3d0e952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:50 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-8f7ec9ac-55d5-4129-886d-705e5461e5d3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868" returned: 0 in 0.320s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4105df00-88b6-4ad2-9a97-d5e25662849a]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0254bb0-1388-42c7-8497-9d62fe0428fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15a92d7-8562-4a93-a4b0-0e41371fa868', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb27633d-3dc6-4972-a894-89f6aff6f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Volume volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 (c15a92d7-8562-4a93-a4b0-0e41371fa868): created successfully Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb27633d-3dc6-4972-a894-89f6aff6f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (22e19aa0-c8de-4857-8088-62f42b5e001c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:50 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d07d053e-1840-4e16-9ac1-3c815ffdedb9 tempest-ProjectReaderTests-1351242153 None] Created volume successfully. Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" acquired by "delete_volume" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:50 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 Sep 28 17:27:50 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e258aae-270d-4a8c-b408-414a1cce964f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 Sep 28 17:27:51 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952" returned: 0 in 0.388s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a Sep 28 17:27:51 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3" returned: 0 in 0.381s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3 Sep 28 17:27:51 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a" returned: 0 in 0.367s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a Sep 28 17:27:51 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-8f7ec9ac-55d5-4129-886d-705e5461e5d3" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-8f7ec9ac-55d5-4129-886d-705e5461e5d3" released by "delete_volume" :: held 0.720s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Created reservations ['3f825789-3580-4b9e-bde6-deb261164d06', 'da1ed6cc-e7d1-4604-8df3-ee03514d4843', '51461e04-3102-451d-8140-82183cc022ea', '71719bc6-ea55-468e-9efc-169e098d6df9'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:51 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952.fc2471e3-3b65-4f61-a2a2-1489474b5e8a" returned: 0 in 0.278s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-fc2471e3-3b65-4f61-a2a2-1489474b5e8a" released by "_delete_snapshot" :: held 1.657s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" released by "delete_snapshot" :: held 1.694s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-5db153c5-b49a-4b31-87c8-6040517e32be-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-5db153c5-b49a-4b31-87c8-6040517e32be-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.343s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "cinder-quobyte-5db153c5-b49a-4b31-87c8-6040517e32be" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Deleted volume successfully. Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Created reservations ['cf698426-d1bd-40c8-ad0b-e18324f6d5a2', 'c9885034-944f-40fe-82a2-13ebc084091e', '6c89b9e2-fee9-4101-a172-a90db02e12ac', '595c0cd9-0170-4d0c-aa57-467dda6bb2c6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-5db153c5-b49a-4b31-87c8-6040517e32be" acquired by "delete_volume" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-136f7d72-1e6a-4f59-b710-5e5a2469af9f tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-8f7ec9ac-55d5-4129-886d-705e5461e5d3-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87a4c4-6002-47fd-b61d-a0c76c296e93]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Creating offline snapshot 90c06e83-d9c2-4efe-952a-5b12a218cb39 of volume c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396ada6-92ce-42a7-85fc-accaff3e3c00]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1039efd9-8cab-4c2c-91b2-809516a01568 tempest-ProjectMemberTests-510569012 None] Lock "cinder-fc2471e3-3b65-4f61-a2a2-1489474b5e8a-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:52 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be Sep 28 17:27:52 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-39b65d94-080d-4367-950c-74f8d3d0e952-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 Sep 28 17:27:52 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "cinder-39b65d94-080d-4367-950c-74f8d3d0e952-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" acquired by "delete_volume" :: waited 0.014s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f33edf9-9fb3-4de3-b114-4a17f12d3a11]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 Sep 28 17:27:52 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be Sep 28 17:27:52 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868" returned: 0 in 0.467s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 1G Sep 28 17:27:52 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952" returned: 0 in 0.397s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5db153c5-b49a-4b31-87c8-6040517e32be" returned: 0 in 0.286s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952 Sep 28 17:27:52 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-quobyte-5db153c5-b49a-4b31-87c8-6040517e32be" released by "delete_volume" :: held 0.789s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:52 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Created reservations ['940bfc5a-1c64-4615-bf4e-b375583e796b', 'cc4b1b2f-7688-4d12-8228-320f5afeb158', 'ca55b2b3-ff5c-4f52-9ba6-d2e2dcc5a18f', '781bd3d6-27a9-4af5-8393-a6d2c8c1a172'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:53 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-39b65d94-080d-4367-950c-74f8d3d0e952" returned: 0 in 0.315s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 1G" returned: 0 in 0.531s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-39b65d94-080d-4367-950c-74f8d3d0e952" released by "delete_volume" :: held 0.801s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:53 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 Sep 28 17:27:53 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Created reservations ['8b52a302-5c7a-4825-8f15-4956bd8e67aa', 'c62d2a7a-3217-43d4-a619-6fdda4559eb0', '963f9053-acdf-4098-9588-4374bc644ef7', 'e7894704-de26-4969-9813-2bfa189a6f02'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.311s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Deleted volume successfully. Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-1b71bc47-0cbc-4f69-8784-2c85ee9a3d1d tempest-CinderUnicodeTest-1564265164 None] Lock "cinder-5db153c5-b49a-4b31-87c8-6040517e32be-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:53 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39" returned: 0 in 0.402s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 is being set with open permissions: ugo+rw Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 Sep 28 17:27:53 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-acedca1a-f5a9-4116-a3e7-19fd4b81de11 tempest-ProjectMemberTests-510569012 None] Lock "cinder-39b65d94-080d-4367-950c-74f8d3d0e952-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:53 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39" returned: 0 in 0.298s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info Sep 28 17:27:54 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (3b1a2443-ed28-4bd1-932f-46e91105fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb140fa6-9056-494f-8659-5087c555d429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb140fa6-9056-494f-8659-5087c555d429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536380792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39ea393-b0f6-43e3-9bef-c6afc6d51579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:54Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc435e6d-3028-48c8-91c4-8e05ab420a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc435e6d-3028-48c8-91c4-8e05ab420a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb153f2-06c7-45ff-99dd-232107eb41f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb153f2-06c7-45ff-99dd-232107eb41f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39ea393-b0f6-43e3-9bef-c6afc6d51579', 'volume_name': 'volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4306ad38-03ca-4e74-bc8d-c59cef20d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4306ad38-03ca-4e74-bc8d-c59cef20d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c1e644-b79a-4045-bae4-94b572e216cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:54 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Volume b39ea393-b0f6-43e3-9bef-c6afc6d51579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579', 'volume_size': 1} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:54 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info" returned: 0 in 0.350s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info is being set with open permissions: ugo+rw Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info Sep 28 17:27:54 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.info" returned: 0 in 0.244s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536380792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39ea393-b0f6-43e3-9bef-c6afc6d51579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:54Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Creating volume b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:54 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:54 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 1073741824 Sep 28 17:27:54 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e732d7b2-6b36-4fbc-a8ef-4952e2bf8e0c tempest-ProjectReaderTests-1351242153 None] Create snapshot completed successfully Sep 28 17:27:55 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 1073741824" returned: 0 in 0.492s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 Sep 28 17:27:55 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-90c06e83-d9c2-4efe-952a-5b12a218cb39-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-90c06e83-d9c2-4efe-952a-5b12a218cb39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-90c06e83-d9c2-4efe-952a-5b12a218cb39" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-90c06e83-d9c2-4efe-952a-5b12a218cb39" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Deleting offline snapshot 90c06e83-d9c2-4efe-952a-5b12a218cb39 of volume c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] snapshot_file for this snap is: volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b32d0a-6061-45cf-a01c-b1b6595e375c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579" returned: 0 in 0.351s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c1e644-b79a-4045-bae4-94b572e216cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80f51c5-6ab6-4aee-9322-597c1f8c1bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:55 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Volume volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 (b39ea393-b0f6-43e3-9bef-c6afc6d51579): created successfully Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80f51c5-6ab6-4aee-9322-597c1f8c1bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (3b1a2443-ed28-4bd1-932f-46e91105fc32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:55 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-48f13e8f-f371-40d4-9025-30d4625bf09a tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:27:55 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 Sep 28 17:27:55 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39" returned: 0 in 0.391s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15a92d7-8562-4a93-a4b0-0e41371fa868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f5f83-0b72-4378-b3a1-7e9aaa1f24ae]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 Sep 28 17:27:55 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868" returned: 0 in 0.389s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 Sep 28 17:27:56 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 of volume b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead193c-0687-41b6-a015-cd51ee130006]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39" returned: 0 in 0.404s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 Sep 28 17:27:56 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39 Sep 28 17:27:56 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868.90c06e83-d9c2-4efe-952a-5b12a218cb39" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-426be780-06ac-4e53-9064-254b5d97a105 tempest-ProjectAdminTests-694938809 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87034) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579" returned: 0 in 0.449s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-90c06e83-d9c2-4efe-952a-5b12a218cb39" released by "_delete_snapshot" :: held 1.591s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:56 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" released by "delete_snapshot" :: held 1.622s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:57 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 1G Sep 28 17:27:57 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Created reservations ['e72c7101-954b-401d-9851-8511d5c76978', 'ae6d6fc2-1527-40ae-a8ea-83333b23ae49', 'd313b953-918e-495d-ab32-22cdab0fa408', '5cf32ab5-cb65-4978-962f-489c28bddaf7'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:57 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Delete snapshot completed successfully. Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4a014001-e915-40bf-b633-409872086c52 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-90c06e83-d9c2-4efe-952a-5b12a218cb39-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:57 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 1G" returned: 0 in 0.457s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 Sep 28 17:27:57 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-c15a92d7-8562-4a93-a4b0-0e41371fa868-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-c15a92d7-8562-4a93-a4b0-0e41371fa868-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" acquired by "delete_volume" :: waited 0.024s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4257c-b2a4-46c4-9f9b-56ba62d72115]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" returned: 0 in 0.378s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 is being set with open permissions: ugo+rw Sep 28 17:27:57 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 Sep 28 17:27:57 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 Sep 28 17:27:57 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868" returned: 0 in 0.403s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info Sep 28 17:27:58 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868 Sep 28 17:27:58 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info is being set with open permissions: ugo+rw Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info Sep 28 17:27:58 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c15a92d7-8562-4a93-a4b0-0e41371fa868" returned: 0 in 0.311s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-c15a92d7-8562-4a93-a4b0-0e41371fa868" released by "delete_volume" :: held 0.809s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Created reservations ['c7534b47-0a32-4f36-b6e7-14a2ec01b5dc', '0a5aad34-46c9-4ebe-9559-a2d961e0adbb', '9b543701-dd71-41ad-83a9-6875ec8df4d6', 'ec21a456-b281-47cd-825b-14faf01ec89b'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:27:58 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.info" returned: 0 in 0.296s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-97bfa1cc-e396-4328-b258-e599ab637ed4 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:27:58 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.325s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:58 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Deleted volume successfully. Sep 28 17:27:58 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-381bb9e7-36ed-4e1c-9d5a-e51fbaccd166 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-c15a92d7-8562-4a93-a4b0-0e41371fa868-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (ade52017-f1c2-4fe2-b721-7d446499dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a8ee8-ea29-4cf5-8feb-12c55dd2cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a8ee8-ea29-4cf5-8feb-12c55dd2cca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613602348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c0e6b4-5f72-457d-944d-89512191d415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:59Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff358e-3f0b-4cde-858e-f4e16fc8c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff358e-3f0b-4cde-858e-f4e16fc8c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb265369-d1f0-47cc-b276-6edacae3051a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb265369-d1f0-47cc-b276-6edacae3051a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c0e6b4-5f72-457d-944d-89512191d415', 'volume_name': 'volume-f7c0e6b4-5f72-457d-944d-89512191d415', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8a5f41-1740-4460-8e1d-77c33dc97096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8a5f41-1740-4460-8e1d-77c33dc97096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00feaf29-a099-4af6-8be5-f9d0bf618cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:59 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Volume f7c0e6b4-5f72-457d-944d-89512191d415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c0e6b4-5f72-457d-944d-89512191d415', 'volume_size': 1} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613602348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c0e6b4-5f72-457d-944d-89512191d415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:59Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Creating volume f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:59 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:59 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 1073741824 Sep 28 17:27:59 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 of volume b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[633af461-d106-44a3-a5d3-82f22b52ca3b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:59 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:59 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 Sep 28 17:27:59 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 1073741824" returned: 0 in 0.547s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:00 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 Sep 28 17:28:00 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" returned: 0 in 0.443s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc756b51-c2c9-43d3-9892-c7200ff8d03c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:00 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415" returned: 0 in 0.280s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00feaf29-a099-4af6-8be5-f9d0bf618cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c0e6b4-5f72-457d-944d-89512191d415', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac7969-0581-4560-b372-066b82733e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:00 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Volume volume-f7c0e6b4-5f72-457d-944d-89512191d415 (f7c0e6b4-5f72-457d-944d-89512191d415): created successfully Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ac7969-0581-4560-b372-066b82733e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:00 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 Sep 28 17:28:00 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (ade52017-f1c2-4fe2-b721-7d446499dbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:00 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-3061dedd-7b76-4621-8250-fbf20efdb3ed tempest-ProjectReaderTests-1351242153 None] Created volume successfully. Sep 28 17:28:00 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579" returned: 0 in 0.408s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:00 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 Sep 28 17:28:00 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:01 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" returned: 0 in 0.363s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:01 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3 Sep 28 17:28:01 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:01 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579.e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" returned: 0 in 0.276s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3" released by "_delete_snapshot" :: held 1.656s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" released by "delete_snapshot" :: held 1.690s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Created reservations ['7303c72f-ae7d-4dc1-8e8c-ae5a70915224', 'f592a13a-a88b-48fb-a536-7645f3059e0c', '47c868ff-f123-4955-9060-42c433c6e0c5', '3f0369d6-ea1b-4af4-872b-4451a2927237'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:01 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-5eb51e81-f02a-483a-a165-0ecc4b6cc857 tempest-ProjectMemberTests-510569012 None] Lock "cinder-e35ac73c-ac5a-4558-a1f1-5a3a672fd1c3-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Creating offline snapshot 20a720bb-ca2c-49b3-a9ca-1cae817e6801 of volume f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb35658-5147-41ed-9d90-73eedfa3068c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-b39ea393-b0f6-43e3-9bef-c6afc6d51579-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "cinder-b39ea393-b0f6-43e3-9bef-c6afc6d51579-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:01 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 Sep 28 17:28:01 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:01 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" acquired by "delete_volume" :: waited 0.025s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b254c9-1d12-4cd0-894e-87a692bd5ef7]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 Sep 28 17:28:02 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415" returned: 0 in 0.467s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 1G Sep 28 17:28:02 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579" returned: 0 in 0.411s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579 Sep 28 17:28:02 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:02 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-b39ea393-b0f6-43e3-9bef-c6afc6d51579" returned: 0 in 0.317s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-b39ea393-b0f6-43e3-9bef-c6afc6d51579" released by "delete_volume" :: held 0.807s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:02 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 1G" returned: 0 in 0.537s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c0e6b4-5f72-457d-944d-89512191d415 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c0e6b4-5f72-457d-944d-89512191d415 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 Sep 28 17:28:02 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Created reservations ['84d4d4e2-875c-4b80-9a56-9e2700884671', 'fe48c34d-a74f-4532-bcb9-fd1d0548453c', '3120b8bf-700b-4428-827c-aed09122ac0a', '3b185e7b-c2e2-484f-925e-125420153a01'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:03 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.391s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:28:03 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c0e6b4-5f72-457d-944d-89512191d415 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801" returned: 0 in 0.422s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 is being set with open permissions: ugo+rw Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 Sep 28 17:28:03 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.420s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:03 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-c38bf0ff-a4c6-4f0b-ae0a-38bb02a9f53a tempest-ProjectMemberTests-510569012 None] Lock "cinder-b39ea393-b0f6-43e3-9bef-c6afc6d51579-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:03 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801" returned: 0 in 0.351s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info Sep 28 17:28:03 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (3521877d-5b9c-4410-9ac2-b88639805879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfb81ad-ff50-4276-a335-5c1d125708cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfb81ad-ff50-4276-a335-5c1d125708cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009303744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea6c6ce-e4ef-4dd6-abfd-218d84167973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:04Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58403c6-3aca-4383-864a-a92995045d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58403c6-3aca-4383-864a-a92995045d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271e6dce-53fd-44d4-9df2-12076d7d9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271e6dce-53fd-44d4-9df2-12076d7d9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea6c6ce-e4ef-4dd6-abfd-218d84167973', 'volume_name': 'volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346cd55-a248-41da-97a3-88843eb26cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346cd55-a248-41da-97a3-88843eb26cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87555f5b-e3d6-45db-90bd-5455684daa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Volume 3ea6c6ce-e4ef-4dd6-abfd-218d84167973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973', 'volume_size': 1} Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:03 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info" returned: 0 in 0.328s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info is being set with open permissions: ugo+rw Sep 28 17:28:03 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info Sep 28 17:28:03 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.info" returned: 0 in 0.290s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1009303744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea6c6ce-e4ef-4dd6-abfd-218d84167973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:04Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Creating volume 3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:04 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 1073741824 Sep 28 17:28:04 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-444042b8-776f-477d-8b03-cbdec5ba2f25 tempest-ProjectReaderTests-1351242153 None] Create snapshot completed successfully Sep 28 17:28:04 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 1073741824" returned: 0 in 0.465s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 Sep 28 17:28:04 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-20a720bb-ca2c-49b3-a9ca-1cae817e6801-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-20a720bb-ca2c-49b3-a9ca-1cae817e6801-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-20a720bb-ca2c-49b3-a9ca-1cae817e6801" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-20a720bb-ca2c-49b3-a9ca-1cae817e6801" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Deleting offline snapshot 20a720bb-ca2c-49b3-a9ca-1cae817e6801 of volume f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] snapshot_file for this snap is: volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[326cfaef-d50b-4de1-946f-7cfc5522641f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" returned: 0 in 0.278s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87555f5b-e3d6-45db-90bd-5455684daa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55736a35-8ed2-492c-8f5f-b9ca675bb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Volume volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 (3ea6c6ce-e4ef-4dd6-abfd-218d84167973): created successfully Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55736a35-8ed2-492c-8f5f-b9ca675bb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (3521877d-5b9c-4410-9ac2-b88639805879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:05 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9fc75ecf-49ad-43fd-965e-07b410f4c091 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:28:05 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 Sep 28 17:28:05 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801" returned: 0 in 0.402s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c0e6b4-5f72-457d-944d-89512191d415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca6b575-c6af-4519-9571-1c152bf4d602]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 Sep 28 17:28:05 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 Sep 28 17:28:05 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot 03ddf331-17f2-4bfc-bd58-30c018156686 of volume 3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dbe754-3531-4b6c-94b6-97d0840e1965]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 Sep 28 17:28:06 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801" returned: 0 in 0.406s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801 Sep 28 17:28:06 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" returned: 0 in 0.436s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415.20a720bb-ca2c-49b3-a9ca-1cae817e6801" returned: 0 in 0.257s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 1G Sep 28 17:28:06 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-20a720bb-ca2c-49b3-a9ca-1cae817e6801" released by "_delete_snapshot" :: held 1.623s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" released by "delete_snapshot" :: held 1.652s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Created reservations ['120e79cf-f0fb-4ad0-a765-6167fcddec6e', '98380963-f00c-4b8d-8193-4ed759c5d4c0', '082f7d59-7ade-45e3-8ba6-dd6b4dded4eb', '1e5b0fcd-adac-4bb7-9e9d-86de91319522'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:06 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Delete snapshot completed successfully. Sep 28 17:28:06 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e3fedd47-f5c9-41b9-b41d-132ef12e5996 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-20a720bb-ca2c-49b3-a9ca-1cae817e6801-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:07 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 1G" returned: 0 in 0.468s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 Sep 28 17:28:07 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-f7c0e6b4-5f72-457d-944d-89512191d415-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "cinder-f7c0e6b4-5f72-457d-944d-89512191d415-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" acquired by "delete_volume" :: waited 0.023s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[2842b98c-8df5-45ce-b696-fbd880bb0fd3]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686" returned: 0 in 0.362s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 is being set with open permissions: ugo+rw Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 Sep 28 17:28:07 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 Sep 28 17:28:07 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686" returned: 0 in 0.275s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415" returned: 0 in 0.438s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info Sep 28 17:28:07 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415 Sep 28 17:28:07 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info" returned: 0 in 0.273s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info is being set with open permissions: ugo+rw Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-f7c0e6b4-5f72-457d-944d-89512191d415" returned: 0 in 0.271s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info Sep 28 17:28:07 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-f7c0e6b4-5f72-457d-944d-89512191d415" released by "delete_volume" :: held 0.803s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Created reservations ['54a52853-adbb-4702-9172-d236e371da08', '43cb7038-b2ee-44af-b242-684c4dc4b1a8', 'd87ed54e-297b-4397-a5e3-284f0114f841', 'f41cad78-cea4-4c31-bc62-15eb7c39612f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:08 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.info" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cfcfe699-3f09-488d-9ca7-1869c56b3a21 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:28:08 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.336s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:08 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Deleted volume successfully. Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e8079ec7-1a4d-4a1c-a00c-5dd2b57d7c1e tempest-ProjectReaderTests-1351242153 None] Lock "cinder-f7c0e6b4-5f72-457d-944d-89512191d415-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (ad8a7c83-a451-4e1e-859c-2096aacd8aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10b18dc-134f-4187-9d59-5eeb1e5f4dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10b18dc-134f-4187-9d59-5eeb1e5f4dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993468988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203231f4-6b14-4201-a249-93402100b21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:09Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e9e2eb-2610-4ea4-a04b-d1559df7032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e9e2eb-2610-4ea4-a04b-d1559df7032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66caa51-ba2f-445b-9651-193cd139ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66caa51-ba2f-445b-9651-193cd139ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203231f4-6b14-4201-a249-93402100b21a', 'volume_name': 'volume-203231f4-6b14-4201-a249-93402100b21a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765ab578-fc00-4953-8161-97fb47aa1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765ab578-fc00-4953-8161-97fb47aa1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d454530-51d2-4fa3-844d-5b59dd0d4819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:08 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Volume 203231f4-6b14-4201-a249-93402100b21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203231f4-6b14-4201-a249-93402100b21a', 'volume_size': 1} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993468988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203231f4-6b14-4201-a249-93402100b21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:09Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Creating volume 203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:08 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:08 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a 1073741824 Sep 28 17:28:08 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-03ddf331-17f2-4bfc-bd58-30c018156686-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-03ddf331-17f2-4bfc-bd58-30c018156686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-03ddf331-17f2-4bfc-bd58-30c018156686" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-03ddf331-17f2-4bfc-bd58-30c018156686" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot 03ddf331-17f2-4bfc-bd58-30c018156686 of volume 3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e96e4-be78-413c-ae14-74db2db95752]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a 1073741824" returned: 0 in 0.520s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a Sep 28 17:28:09 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 Sep 28 17:28:09 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a" returned: 0 in 0.260s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d454530-51d2-4fa3-844d-5b59dd0d4819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203231f4-6b14-4201-a249-93402100b21a', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f291ce-77c7-42db-b8f5-93c5eea1077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Volume volume-203231f4-6b14-4201-a249-93402100b21a (203231f4-6b14-4201-a249-93402100b21a): created successfully Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f291ce-77c7-42db-b8f5-93c5eea1077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (ad8a7c83-a451-4e1e-859c-2096aacd8aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:09 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-c5ccf906-2d15-456a-b2c1-a0fafa152bc8 tempest-ProjectReaderTests-1351242153 None] Created volume successfully. Sep 28 17:28:09 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686" returned: 0 in 0.399s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e02ca1f-2005-4a57-873d-32f12ac2c725]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:09 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 Sep 28 17:28:09 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" returned: 0 in 0.347s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 Sep 28 17:28:10 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686" returned: 0 in 0.321s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686 Sep 28 17:28:10 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973.03ddf331-17f2-4bfc-bd58-30c018156686" returned: 0 in 0.254s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-03ddf331-17f2-4bfc-bd58-30c018156686" released by "_delete_snapshot" :: held 1.421s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" released by "delete_snapshot" :: held 1.446s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Created reservations ['2156265a-76ea-4083-9200-ec7575935faa', '7d69b9bf-42cf-48a6-a56c-5c25d7a5cf16', '6f950cc6-8ae6-4aab-a82f-77c83d973331', '0ab3ffde-036c-4e33-978d-50a6f70106e5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:10 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:28:10 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-aabbbe5d-3c7c-415d-9ca0-2b10b0f76da2 tempest-ProjectMemberTests-510569012 None] Lock "cinder-03ddf331-17f2-4bfc-bd58-30c018156686-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Creating offline snapshot 9f1f25b2-4a86-47f5-9291-6d192f3d0016 of volume 203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db066a4-47a0-47d2-98e7-dc175a5a4efb]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a Sep 28 17:28:11 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a" returned: 0 in 0.360s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 1G Sep 28 17:28:11 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-3ea6c6ce-e4ef-4dd6-abfd-218d84167973-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "cinder-3ea6c6ce-e4ef-4dd6-abfd-218d84167973-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca48f621-b2ea-4571-98c4-deb28db0f5cc]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 Sep 28 17:28:11 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 1G" returned: 0 in 0.415s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-203231f4-6b14-4201-a249-93402100b21a -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-203231f4-6b14-4201-a249-93402100b21a -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 Sep 28 17:28:11 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" returned: 0 in 0.376s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973 Sep 28 17:28:12 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-203231f4-6b14-4201-a249-93402100b21a -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016" returned: 0 in 0.299s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 is being set with open permissions: ugo+rw Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 Sep 28 17:28:12 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" returned: 0 in 0.280s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3ea6c6ce-e4ef-4dd6-abfd-218d84167973" released by "delete_volume" :: held 0.724s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Created reservations ['a5492176-aa6c-4a4d-8b51-e96ee3c6329b', 'bf8bb8bc-22d9-49f8-a95d-7bb1ca76619b', 'bbae5988-a92f-4f75-b515-7c7f8c553950', '775f6589-578f-43e2-b1c2-2b64fcd21a22'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:12 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016" returned: 0 in 0.243s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:12 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:12 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info is being set with open permissions: ugo+rw Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.255s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:12 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info Sep 28 17:28:12 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-e85d2698-11ef-4ffe-90c0-998ff7c8c6ad tempest-ProjectMemberTests-510569012 None] Lock "cinder-3ea6c6ce-e4ef-4dd6-abfd-218d84167973-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.info" returned: 0 in 0.285s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:13 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-328a58b4-5f03-4ba7-9704-889b7ef040a0 tempest-ProjectReaderTests-1351242153 None] Create snapshot completed successfully Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (bfc341f6-0c8b-4819-b866-5f8816ea327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d47e44f-f3df-4a6f-a286-30acdbdc86d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-9f1f25b2-4a86-47f5-9291-6d192f3d0016-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d47e44f-f3df-4a6f-a286-30acdbdc86d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575214821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5705c25b-2344-4027-a9dd-ce71409725c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:13Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd17dda-7ce1-4e67-ac7b-2654f6f7c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd17dda-7ce1-4e67-ac7b-2654f6f7c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec0ea6-de6c-4cb0-8aad-4e9cacbe8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ec0ea6-de6c-4cb0-8aad-4e9cacbe8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5705c25b-2344-4027-a9dd-ce71409725c1', 'volume_name': 'volume-5705c25b-2344-4027-a9dd-ce71409725c1', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d160b65e-55eb-4dbb-9ae2-3e61e9cd0ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d160b65e-55eb-4dbb-9ae2-3e61e9cd0ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f49c21-04cb-4af9-bfbe-2d9bb6c0827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:13 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Volume 5705c25b-2344-4027-a9dd-ce71409725c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5705c25b-2344-4027-a9dd-ce71409725c1', 'volume_size': 1} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575214821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5705c25b-2344-4027-a9dd-ce71409725c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:13Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Creating volume 5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:13 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 1073741824 Sep 28 17:28:13 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-9f1f25b2-4a86-47f5-9291-6d192f3d0016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-9f1f25b2-4a86-47f5-9291-6d192f3d0016" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-9f1f25b2-4a86-47f5-9291-6d192f3d0016" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Deleting offline snapshot 9f1f25b2-4a86-47f5-9291-6d192f3d0016 of volume 203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] snapshot_file for this snap is: volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb78c8b-58b8-4594-87d5-7ef5073fb22b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 Sep 28 17:28:13 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 1073741824" returned: 0 in 0.441s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 Sep 28 17:28:13 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016" returned: 0 in 0.441s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-203231f4-6b14-4201-a249-93402100b21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f184d-2c51-49cc-acde-a42ff48e1136]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a Sep 28 17:28:13 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1" returned: 0 in 0.267s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:13 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f49c21-04cb-4af9-bfbe-2d9bb6c0827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5705c25b-2344-4027-a9dd-ce71409725c1', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd44200b-bb4b-4132-af8f-32173f3aab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Volume volume-5705c25b-2344-4027-a9dd-ce71409725c1 (5705c25b-2344-4027-a9dd-ce71409725c1): created successfully Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd44200b-bb4b-4132-af8f-32173f3aab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (bfc341f6-0c8b-4819-b866-5f8816ea327f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-da0d1bc6-9de0-475a-bb17-7028ebef2ac5 tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:28:14 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a" returned: 0 in 0.430s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 Sep 28 17:28:14 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016" returned: 0 in 0.304s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016 Sep 28 17:28:14 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a.9f1f25b2-4a86-47f5-9291-6d192f3d0016" returned: 0 in 0.248s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-9f1f25b2-4a86-47f5-9291-6d192f3d0016" released by "_delete_snapshot" :: held 1.532s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" released by "delete_snapshot" :: held 1.561s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Created reservations ['a60b1468-6212-4210-b41b-af975382869b', '536a72c2-c2e7-48c3-b92f-d4a10d533cf9', '3e5b8ce8-f3cc-4a59-bc8d-fe0987bdba00', '3e6398de-6e34-4f81-b553-8976f6516ff8'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:14 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Delete snapshot completed successfully. Sep 28 17:28:14 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ab19b74-bb7b-4db1-8059-ac7e1beaf625 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-9f1f25b2-4a86-47f5-9291-6d192f3d0016-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-203231f4-6b14-4201-a249-93402100b21a-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-203231f4-6b14-4201-a249-93402100b21a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Creating offline snapshot 470d6365-a3f4-432a-9e1d-f9fee891a4ed of volume 5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679b864-ad01-404c-b52a-2076460fd726]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" acquired by "delete_volume" :: waited 0.031s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6213c8f-e82e-464f-8956-0e3c894a7efb]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 Sep 28 17:28:15 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a Sep 28 17:28:15 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1" returned: 0 in 0.402s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed 1G Sep 28 17:28:15 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a" returned: 0 in 0.448s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a Sep 28 17:28:15 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-203231f4-6b14-4201-a249-93402100b21a" returned: 0 in 0.274s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-203231f4-6b14-4201-a249-93402100b21a" released by "delete_volume" :: held 0.790s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:16 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed 1G" returned: 0 in 0.437s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5705c25b-2344-4027-a9dd-ce71409725c1 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Created reservations ['5f78d9c4-6466-4d6a-be5f-2f6ea2943bc4', '3bc407cb-177c-4221-a585-96c14d9dfa2b', '78c31e47-52d6-4fff-9152-6164d7773d95', '007229df-9fcb-4926-a234-290168dbdcd5'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:16 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5705c25b-2344-4027-a9dd-ce71409725c1 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed Sep 28 17:28:16 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:16 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5705c25b-2344-4027-a9dd-ce71409725c1 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed" returned: 0 in 0.340s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed is being set with open permissions: ugo+rw Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed Sep 28 17:28:16 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:16 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Deleted volume successfully. Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-876c9b0d-66fd-4030-8e9e-5dbc28e62549 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-203231f4-6b14-4201-a249-93402100b21a-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:16 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed" returned: 0 in 0.283s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info Sep 28 17:28:16 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (2aed02c4-dc09-433c-a480-277a4f82884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7f11cb-43a5-49b7-ae62-095d6ba9c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7f11cb-43a5-49b7-ae62-095d6ba9c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695708166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5173c7-34b9-4cd8-a726-51a01df4d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:17Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de5d86e-2572-4516-84d5-19d9d4427c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de5d86e-2572-4516-84d5-19d9d4427c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa974a-f1c1-4b10-9990-66b16c114f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa974a-f1c1-4b10-9990-66b16c114f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5173c7-34b9-4cd8-a726-51a01df4d2ed', 'volume_name': 'volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efede5-0488-4e26-9f0d-e404dfd2469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efede5-0488-4e26-9f0d-e404dfd2469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7106f58-27bb-40e1-b345-adc3325f1228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Volume dc5173c7-34b9-4cd8-a726-51a01df4d2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed', 'volume_size': 1} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:17 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info is being set with open permissions: ugo+rw Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info Sep 28 17:28:17 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.info" returned: 0 in 0.244s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695708166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5173c7-34b9-4cd8-a726-51a01df4d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea747d5efaf4c7eb07ad33b5bc68eca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:17Z,use_quota=True,user_id='c1a2f601eb2543bcba934a6c3b01b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Creating volume dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:17 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed 1073741824 Sep 28 17:28:17 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f869f9b7-377c-46b7-8825-4a235d0cce3b tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:28:17 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed 1073741824" returned: 0 in 0.433s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed Sep 28 17:28:17 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:18 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" returned: 0 in 0.275s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=306,cinder:SELECT=246,cinder:DELETE=24,cinder:INSERT=81 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7106f58-27bb-40e1-b345-adc3325f1228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4476cf3-aa2a-45b9-986b-c63e8f77b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=219,cinder:UPDATE=330,cinder:INSERT=84,cinder:DELETE=27 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:18 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Volume volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed (dc5173c7-34b9-4cd8-a726-51a01df4d2ed): created successfully Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4476cf3-aa2a-45b9-986b-c63e8f77b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Flow 'volume_create_manager' (2aed02c4-dc09-433c-a480-277a4f82884b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:18 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-174906b6-847a-46b1-8dd4-68e0aa9c79fe tempest-ProjectReaderTests-1351242153 None] Created volume successfully. Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-470d6365-a3f4-432a-9e1d-f9fee891a4ed-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-470d6365-a3f4-432a-9e1d-f9fee891a4ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-470d6365-a3f4-432a-9e1d-f9fee891a4ed" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-470d6365-a3f4-432a-9e1d-f9fee891a4ed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot 470d6365-a3f4-432a-9e1d-f9fee891a4ed of volume 5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb565d98-66ec-44a0-ac80-fd002f9bd822]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:18 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed Sep 28 17:28:18 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed" returned: 0 in 0.359s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5705c25b-2344-4027-a9dd-ce71409725c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc508ec-23c3-4c26-8b25-0bba1794e410]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 Sep 28 17:28:19 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Creating offline snapshot e62e8319-91d5-47be-9029-b82168fb20d5 of volume dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[634880ac-3012-4c3e-a46b-099d38789edc]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed Sep 28 17:28:19 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1" returned: 0 in 0.416s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed Sep 28 17:28:19 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" returned: 0 in 0.434s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 1G Sep 28 17:28:19 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed" returned: 0 in 0.405s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed Sep 28 17:28:19 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:20 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1.470d6365-a3f4-432a-9e1d-f9fee891a4ed" returned: 0 in 0.284s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 1G" returned: 0 in 0.452s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-470d6365-a3f4-432a-9e1d-f9fee891a4ed" released by "_delete_snapshot" :: held 1.579s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" released by "delete_snapshot" :: held 1.607s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 Sep 28 17:28:20 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Created reservations ['653ac053-de91-4647-b9d7-a5e6e30f3448', '782127b8-3dee-480a-b2e7-92f350244f52', '6c99b5ee-5362-41ec-81ad-2bbf2145b805', 'aa733db4-7338-4a9c-88c5-0f766d6ef0c9'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:20 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-f9524e7f-6c45-4fe5-b686-0a1dc5b0871f tempest-ProjectMemberTests-510569012 None] Lock "cinder-470d6365-a3f4-432a-9e1d-f9fee891a4ed-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5" returned: 0 in 0.297s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 is being set with open permissions: ugo+rw Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 Sep 28 17:28:20 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:20 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5" returned: 0 in 0.241s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-5705c25b-2344-4027-a9dd-ce71409725c1-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "cinder-5705c25b-2344-4027-a9dd-ce71409725c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:20 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info Sep 28 17:28:20 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd1e07-f9e6-4082-a1ad-cbe899dda8f9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 Sep 28 17:28:21 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info" returned: 0 in 0.267s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info is being set with open permissions: ugo+rw Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info Sep 28 17:28:21 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1" returned: 0 in 0.392s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.info" returned: 0 in 0.259s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1 Sep 28 17:28:21 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-328f3be5-b9b7-43e7-b032-6d0feaf26cd1 tempest-ProjectReaderTests-1351242153 None] Create snapshot completed successfully Sep 28 17:28:21 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-5705c25b-2344-4027-a9dd-ce71409725c1" returned: 0 in 0.255s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-5705c25b-2344-4027-a9dd-ce71409725c1" released by "delete_volume" :: held 0.709s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Created reservations ['72174e27-02de-4e54-8ebe-33e18588a586', '7637d356-59f0-41cd-9e72-79e562739c7a', '6883eeac-a070-4c7a-bb28-37f935da5895', 'e2d750ee-2cb3-472d-9934-52b6fd6e6046'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:21 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.241s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:21 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:28:21 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-4f35ce42-3b63-422e-9bb2-f09a1ff24844 tempest-ProjectMemberTests-510569012 None] Lock "cinder-5705c25b-2344-4027-a9dd-ce71409725c1-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (7aae0c92-4f90-4620-8ae1-74763432b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd0a533-2093-4011-a013-f12db5467113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd0a533-2093-4011-a013-f12db5467113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574131612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da082f7-b513-49e8-aa7b-3b39ce1e5e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:22Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c74121-b803-42bf-b681-df4b7e3a321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c74121-b803-42bf-b681-df4b7e3a321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190dea15-eec8-4342-9be6-e6a484aa9de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190dea15-eec8-4342-9be6-e6a484aa9de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da082f7-b513-49e8-aa7b-3b39ce1e5e92', 'volume_name': 'volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c25e22-9341-43b8-986c-da4a677f3e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c25e22-9341-43b8-986c-da4a677f3e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285f8356-66d6-402f-963d-4a8c6364682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Volume 2da082f7-b513-49e8-aa7b-3b39ce1e5e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92', 'volume_size': 1} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1574131612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da082f7-b513-49e8-aa7b-3b39ce1e5e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7eb6e2548f4089927a7e344c277ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:22Z,use_quota=True,user_id='e1c3011314cb4603ba451d4ad6c47159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Creating volume 2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:22 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-e62e8319-91d5-47be-9029-b82168fb20d5-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:22 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 1073741824 Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-e62e8319-91d5-47be-9029-b82168fb20d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:22 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-e62e8319-91d5-47be-9029-b82168fb20d5" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-e62e8319-91d5-47be-9029-b82168fb20d5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Deleting offline snapshot e62e8319-91d5-47be-9029-b82168fb20d5 of volume dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] snapshot_file for this snap is: volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[af837d88-8a25-4248-a9ea-1414ccd9216c]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 Sep 28 17:28:22 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 1073741824" returned: 0 in 0.423s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5" returned: 0 in 0.378s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:22 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 Sep 28 17:28:22 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c190c-fd36-40ae-ab4c-14f7f2e66940]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:23 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed Sep 28 17:28:23 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" returned: 0 in 0.261s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285f8356-66d6-402f-963d-4a8c6364682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f8f039-3519-4a62-b39e-1dde9a5740e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:23 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Volume volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 (2da082f7-b513-49e8-aa7b-3b39ce1e5e92): created successfully Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f8f039-3519-4a62-b39e-1dde9a5740e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Flow 'volume_create_manager' (7aae0c92-4f90-4620-8ae1-74763432b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:23 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ec260c37-93b6-4284-a25c-e3d6ff30e17a tempest-ProjectMemberTests-510569012 None] Created volume successfully. Sep 28 17:28:23 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" returned: 0 in 0.405s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:23 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 Sep 28 17:28:23 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Creating offline snapshot 3031bec9-7844-44c6-a74a-f0fcfe4cd979 of volume 2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[c454f3c0-78b6-423b-95f4-9bf64058bbd1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:23 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 Sep 28 17:28:23 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5" returned: 0 in 0.423s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:23 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:23 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5 Sep 28 17:28:23 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" returned: 0 in 0.401s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 1G Sep 28 17:28:24 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed.e62e8319-91d5-47be-9029-b82168fb20d5" returned: 0 in 0.309s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-e62e8319-91d5-47be-9029-b82168fb20d5" released by "_delete_snapshot" :: held 1.629s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" released by "delete_snapshot" :: held 1.651s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Created reservations ['5de5685c-a575-4df9-bfe3-d6ffc417c495', '72787019-6c9f-420a-a430-ebfd6d3e817e', '3c8408d7-77d1-44ac-9794-bcae1a32d7c7', '686c3744-c4c5-40cf-9486-3143e04a5f8f'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:24 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Delete snapshot completed successfully. Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-83a8b266-2050-4eb3-80db-b284242bc979 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-e62e8319-91d5-47be-9029-b82168fb20d5-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:24 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 1G" returned: 0 in 0.462s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 Sep 28 17:28:24 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-dc5173c7-34b9-4cd8-a726-51a01df4d2ed-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-dc5173c7-34b9-4cd8-a726-51a01df4d2ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab8561e-3c7b-4db7-a752-be11ca8a2df6]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979" returned: 0 in 0.304s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 is being set with open permissions: ugo+rw Sep 28 17:28:24 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 Sep 28 17:28:24 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed Sep 28 17:28:24 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979" returned: 0 in 0.263s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info Sep 28 17:28:25 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" returned: 0 in 0.421s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed Sep 28 17:28:25 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info" returned: 0 in 0.258s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info is being set with open permissions: ugo+rw Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info Sep 28 17:28:25 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" returned: 0 in 0.262s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-quobyte-dc5173c7-34b9-4cd8-a726-51a01df4d2ed" released by "delete_volume" :: held 0.758s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Created reservations ['bbc45310-9585-4a46-adee-9f4b0c3dd5bb', '4fc845a8-308b-4b8e-a270-5bfd3b951a3a', 'fce51249-8093-4692-975b-4a3fed0c3960', 'e99c5f4a-912a-4a6e-8626-f4130f6fd414'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.info" returned: 0 in 0.269s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:25 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-ea16c2b7-d9bb-4ded-a1d1-950f14f1b4c0 tempest-ProjectMemberTests-510569012 None] Create snapshot completed successfully Sep 28 17:28:25 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.270s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:25 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Deleted volume successfully. Sep 28 17:28:25 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-0d5b2975-d70e-4138-9a9a-6782e6da7f48 tempest-ProjectReaderTests-1351242153 None] Lock "cinder-dc5173c7-34b9-4cd8-a726-51a01df4d2ed-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-3031bec9-7844-44c6-a74a-f0fcfe4cd979-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-3031bec9-7844-44c6-a74a-f0fcfe4cd979-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-3031bec9-7844-44c6-a74a-f0fcfe4cd979" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3031bec9-7844-44c6-a74a-f0fcfe4cd979" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Deleting offline snapshot 3031bec9-7844-44c6-a74a-f0fcfe4cd979 of volume 2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] snapshot_file for this snap is: volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[68133636-0d5d-4e65-866d-c204a28b1e5f]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 Sep 28 17:28:27 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:27 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979" returned: 0 in 0.428s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc5473-ed81-42f1-b8a3-4817452c855d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 Sep 28 17:28:27 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:27 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" returned: 0 in 0.380s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 Sep 28 17:28:27 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:28 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979" returned: 0 in 0.375s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:28 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979 Sep 28 17:28:28 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:28 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92.3031bec9-7844-44c6-a74a-f0fcfe4cd979" returned: 0 in 0.250s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-3031bec9-7844-44c6-a74a-f0fcfe4cd979" released by "_delete_snapshot" :: held 1.555s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" released by "delete_snapshot" :: held 1.580s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Created reservations ['5d888c20-2391-4776-9ec7-d482682a03ae', 'c331da7c-3d85-4a87-a47f-fadba35cce98', '26c46bf4-de1e-490f-b461-ddb2b318f6ab', '84c40f93-d469-4bb0-b353-627b20d247b4'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:28 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Delete snapshot completed successfully. Sep 28 17:28:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-652147ea-8f15-4a93-add1-d20481191d16 tempest-ProjectMemberTests-510569012 None] Lock "cinder-3031bec9-7844-44c6-a74a-f0fcfe4cd979-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-2da082f7-b513-49e8-aa7b-3b39ce1e5e92-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "cinder-2da082f7-b513-49e8-aa7b-3b39ce1e5e92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Acquiring lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" acquired by "delete_volume" :: waited 0.018s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d65cc8e-7d87-4506-b0b7-03073cddceae]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:29 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 Sep 28 17:28:29 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:29 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" returned: 0 in 0.421s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:29 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92 Sep 28 17:28:29 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:29 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" returned: 0 in 0.264s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "cinder-quobyte-2da082f7-b513-49e8-aa7b-3b39ce1e5e92" released by "delete_volume" :: held 0.766s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Created reservations ['091a8f84-cf1d-4b28-80a1-d80b7644e65f', '8bf9457d-76fd-44c9-8df0-07d8b368dec9', 'ab50e215-12a9-408b-88a6-1e0bc820bc71', '9f03818f-c982-4334-b897-6311ab983bb6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:30 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:30 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:30 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.289s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Deleted volume successfully. Sep 28 17:28:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-65d174be-7d5e-41ca-b67a-56a1081cabee tempest-ProjectMemberTests-510569012 None] Lock "cinder-2da082f7-b513-49e8-aa7b-3b39ce1e5e92-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:40 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=45,cinder:DELETE=5,cinder:SELECT=38,cinder:INSERT=12 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:40 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=34,cinder:INSERT=15,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Flow 'volume_create_manager' (58c9e319-4cd3-499f-ad3c-2932b1846bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f10b2-265c-40a1-8232-86f57624c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27f10b2-265c-40a1-8232-86f57624c561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655749150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cea20a-7755-4d23-8fda-a25f4f3f51d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8e051cabaa405e919f292993d10704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:49Z,use_quota=True,user_id='f2920c19b1cf4a3c9e6473c190c82537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f21d6ef-1945-4b10-9d1a-94b79d1d9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f21d6ef-1945-4b10-9d1a-94b79d1d9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5040337-aa2c-4bf7-98ba-64a45d490336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5040337-aa2c-4bf7-98ba-64a45d490336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cea20a-7755-4d23-8fda-a25f4f3f51d2', 'volume_name': 'volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fea92b4-9e8e-42f6-8a50-2c81c65c8364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fea92b4-9e8e-42f6-8a50-2c81c65c8364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf68dfba-5a35-4622-abbf-96b798112543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Volume c6cea20a-7755-4d23-8fda-a25f4f3f51d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2', 'volume_size': 1} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655749150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cea20a-7755-4d23-8fda-a25f4f3f51d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8e051cabaa405e919f292993d10704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:49Z,use_quota=True,user_id='f2920c19b1cf4a3c9e6473c190c82537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Creating volume c6cea20a-7755-4d23-8fda-a25f4f3f51d2 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:49 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 1073741824 Sep 28 17:28:49 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 1073741824" returned: 0 in 0.407s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 Sep 28 17:28:49 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" returned: 0 in 0.230s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf68dfba-5a35-4622-abbf-96b798112543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c27f390-3e52-4c54-9b9d-c14ada859ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:49 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Volume volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 (c6cea20a-7755-4d23-8fda-a25f4f3f51d2): created successfully Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c27f390-3e52-4c54-9b9d-c14ada859ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:49 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Flow 'volume_create_manager' (58c9e319-4cd3-499f-ad3c-2932b1846bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:49 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-84f99498-98f8-46bc-9681-aa12b3861fc1 tempest-ProjectReaderTests-528018160 None] Created volume successfully. Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Acquiring lock "cinder-c6cea20a-7755-4d23-8fda-a25f4f3f51d2-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "cinder-c6cea20a-7755-4d23-8fda-a25f4f3f51d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Acquiring lock "cinder-quobyte-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "cinder-quobyte-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" acquired by "delete_volume" :: waited 0.014s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc9902-705c-444e-8e90-f7e847eaf5e1]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 Sep 28 17:28:50 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" returned: 0 in 0.357s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2 Sep 28 17:28:50 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" returned: 0 in 0.235s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "cinder-quobyte-c6cea20a-7755-4d23-8fda-a25f4f3f51d2" released by "delete_volume" :: held 0.637s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Created reservations ['894f523c-1951-4423-9fa6-32b0144f0481', 'ced21f90-0331-4ce8-b97e-3200d1fb87e2', '227d8200-ac45-4905-be1b-25561847d385', '12e5566a-501f-448d-9c3f-93b13dfbabe3'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:51 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.234s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:51 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Deleted volume successfully. Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-714e08bf-3d69-44f5-87e7-bd3b43a7cab1 tempest-ProjectReaderTests-528018160 None] Lock "cinder-c6cea20a-7755-4d23-8fda-a25f4f3f51d2-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Flow 'volume_create_manager' (799811ac-ba3e-4a80-8779-1452a7d1d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cb940f-5eae-4cde-ab3b-c1cdc3c41a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cb940f-5eae-4cde-ab3b-c1cdc3c41a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393489496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce34d833-5473-4983-b05b-cec25c1c7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8e051cabaa405e919f292993d10704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:52Z,use_quota=True,user_id='f2920c19b1cf4a3c9e6473c190c82537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aafe40d-6dbb-444f-bb28-d534fb345d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aafe40d-6dbb-444f-bb28-d534fb345d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf61134-7d0f-402f-8be3-c9aecf056707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf61134-7d0f-402f-8be3-c9aecf056707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce34d833-5473-4983-b05b-cec25c1c7050', 'volume_name': 'volume-ce34d833-5473-4983-b05b-cec25c1c7050', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c6549-c259-4dfa-b196-75984f5cd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c6549-c259-4dfa-b196-75984f5cd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be19d531-db91-4924-9f41-974613f2ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:51 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Volume ce34d833-5473-4983-b05b-cec25c1c7050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce34d833-5473-4983-b05b-cec25c1c7050', 'volume_size': 1} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393489496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce34d833-5473-4983-b05b-cec25c1c7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8e051cabaa405e919f292993d10704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:52Z,use_quota=True,user_id='f2920c19b1cf4a3c9e6473c190c82537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Creating volume ce34d833-5473-4983-b05b-cec25c1c7050 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:51 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:28:51 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 1073741824 Sep 28 17:28:51 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 1073741824" returned: 0 in 0.414s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 Sep 28 17:28:52 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050" returned: 0 in 0.228s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be19d531-db91-4924-9f41-974613f2ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce34d833-5473-4983-b05b-cec25c1c7050', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446ca33-1a91-4f6c-9350-130045a2943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:52 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Volume volume-ce34d833-5473-4983-b05b-cec25c1c7050 (ce34d833-5473-4983-b05b-cec25c1c7050): created successfully Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d446ca33-1a91-4f6c-9350-130045a2943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Flow 'volume_create_manager' (799811ac-ba3e-4a80-8779-1452a7d1d903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:52 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-cd58b318-9045-40a6-b4c7-b349cca033d5 tempest-ProjectReaderTests-528018160 None] Created volume successfully. Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Acquiring lock "cinder-ce34d833-5473-4983-b05b-cec25c1c7050-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "cinder-ce34d833-5473-4983-b05b-cec25c1c7050-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Acquiring lock "cinder-quobyte-ce34d833-5473-4983-b05b-cec25c1c7050" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "cinder-quobyte-ce34d833-5473-4983-b05b-cec25c1c7050" acquired by "delete_volume" :: waited 0.014s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c568b1d-d152-4145-8d33-6bc86e6bf292]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:52 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 Sep 28 17:28:53 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050" returned: 0 in 0.350s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050 Sep 28 17:28:53 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-ce34d833-5473-4983-b05b-cec25c1c7050" returned: 0 in 0.235s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "cinder-quobyte-ce34d833-5473-4983-b05b-cec25c1c7050" released by "delete_volume" :: held 0.623s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Created reservations ['5da363e5-780f-472b-bf49-bf2fb79285c9', '97b05501-4b70-41f3-9677-5a6dec3953f1', '6ea59ab4-097d-4d4d-a7de-0979c1611255', 'd7c844ba-2a6b-482a-8f36-9a409571d367'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:28:53 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:53 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.231s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:53 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Deleted volume successfully. Sep 28 17:28:53 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-8ac32d02-29d3-4480-b5c7-01f84cab304a tempest-ProjectReaderTests-528018160 None] Lock "cinder-ce34d833-5473-4983-b05b-cec25c1c7050-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:02 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:29:02 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:02 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.268s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:29:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:29:03 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:03 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=11 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Flow 'volume_create_manager' (54e5f685-2fa7-42e6-aed7-3055e0904183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522767a3-2239-4b04-9592-b973c59a5cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522767a3-2239-4b04-9592-b973c59a5cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-999136495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afd252f-8d9b-47e6-b591-847ded231239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2712175adb74041a7418783a51de2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:16Z,use_quota=True,user_id='8cf98122f1b84076abc59c9231a5059c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be9be03-1300-42ff-8502-968fa16123f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be9be03-1300-42ff-8502-968fa16123f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e293af5b-1d5d-4fd2-8dbd-86991a3eddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e293af5b-1d5d-4fd2-8dbd-86991a3eddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0afd252f-8d9b-47e6-b591-847ded231239', 'volume_name': 'volume-0afd252f-8d9b-47e6-b591-847ded231239', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e467b02d-4fb7-40cd-97e0-2a1d49f4c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e467b02d-4fb7-40cd-97e0-2a1d49f4c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71da7cd-cd17-47c6-97d1-ebf46154e58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Volume 0afd252f-8d9b-47e6-b591-847ded231239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0afd252f-8d9b-47e6-b591-847ded231239', 'volume_size': 1} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-999136495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0afd252f-8d9b-47e6-b591-847ded231239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2712175adb74041a7418783a51de2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:16Z,use_quota=True,user_id='8cf98122f1b84076abc59c9231a5059c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)}" {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Creating volume 0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:16 devstack cinder-volume[87034]: INFO cinder.volume.drivers.remotefs [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] casted to osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 1073741824 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:16 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 1073741824 Sep 28 17:29:16 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:16 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 1073741824" returned: 0 in 0.435s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:16 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:17 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:17 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.266s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'} {{(pid=87034) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71da7cd-cd17-47c6-97d1-ebf46154e58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0afd252f-8d9b-47e6-b591-847ded231239', 'volume_size': 1}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d58ced-b857-495b-945b-54099b5f6c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:17 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Volume volume-0afd252f-8d9b-47e6-b591-847ded231239 (0afd252f-8d9b-47e6-b591-847ded231239): created successfully Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d58ced-b857-495b-945b-54099b5f6c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Flow 'volume_create_manager' (54e5f685-2fa7-42e6-aed7-3055e0904183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:17 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-068b7243-2607-48f9-bfc0-1963e6d65c2b tempest-SnapshotDependencyTests-1157597043 None] Created volume successfully. Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Creating offline snapshot 3da2e669-59a4-4d58-b071-8c348cb2a161 of volume 0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec0dcb0-cd88-423c-a638-b7aab1283194]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:17 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:17 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.361s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 1G {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 1G Sep 28 17:29:18 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 1G" returned: 0 in 0.401s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0afd252f-8d9b-47e6-b591-847ded231239 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0afd252f-8d9b-47e6-b591-847ded231239 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:18 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0afd252f-8d9b-47e6-b591-847ded231239 -F qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.295s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 is being set with open permissions: ugo+rw Sep 28 17:29:18 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:18 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.259s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info Sep 28 17:29:19 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info" returned: 0 in 0.249s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info is being set with open permissions: ugo+rw Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info Sep 28 17:29:19 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.info" returned: 0 in 0.255s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:19 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-bbdddc64-22ce-4185-a58d-75b840685261 tempest-SnapshotDependencyTests-1157597043 None] Create snapshot completed successfully Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.flows.manager.create_volume [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87034) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Flow 'volume_create_manager' (0dd45c56-f522-4387-8bb2-518a9610d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70697f6-f3be-4038-abf2-22ad4fedbb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70697f6-f3be-4038-abf2-22ad4fedbb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e65d6b-516a-414b-af8e-d42e5beb0ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2712175adb74041a7418783a51de2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3da2e669-59a4-4d58-b071-8c348cb2a161,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:20Z,use_quota=True,user_id='8cf98122f1b84076abc59c9231a5059c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c48e7ec2-4750-4445-8f4a-ea228e4ded9e),volume_type_id=c48e7ec2-4750-4445-8f4a-ea228e4ded9e)' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba48988-e369-47b2-96a0-e3fc59949efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba48988-e369-47b2-96a0-e3fc59949efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87592f7d-16a9-446e-b111-ae6258641379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87592f7d-16a9-446e-b111-ae6258641379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1e65d6b-516a-414b-af8e-d42e5beb0ca7', 'volume_name': 'volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7', 'volume_size': 1, 'snapshot_id': '3da2e669-59a4-4d58-b071-8c348cb2a161'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e1b458-5c93-427e-b2a8-3b58e4ba7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e1b458-5c93-427e-b2a8-3b58e4ba7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102d0551-7a8e-4edb-8c2d-3ce2cebdc11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Volume c1e65d6b-516a-414b-af8e-d42e5beb0ca7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7', 'volume_size': 1, 'snapshot_id': '3da2e669-59a4-4d58-b071-8c348cb2a161'} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" by "_create_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Creating volume c1e65d6b-516a-414b-af8e-d42e5beb0ca7 from snapshot 3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Selected osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d as target Quobyte volume. {{(pid=87034) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" by "_copy_volume_from_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] snapshot: 3da2e669-59a4-4d58-b071-8c348cb2a161, volume: c1e65d6b-516a-414b-af8e-d42e5beb0ca7, {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4787c-f224-4910-ab50-b24e7c71840d]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:20 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:20 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.358s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0afd252f-8d9b-47e6-b591-847ded231239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[9143dd11-dbea-4fa8-a6f4-db54eb47a1c9]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:21 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.384s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Creating direct copy from snapshot {{(pid=87034) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG cinder.utils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Path /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 not found in is_blk_device check {{(pid=87034) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:29:21 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 Sep 28 17:29:21 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" returned: 0 in 5.538s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Image conversion details: src /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 {{(pid=87034) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:26 devstack cinder-volume[87034]: INFO cinder.image.image_utils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Converted 1024.00 MB image at 184.86 MB/s Sep 28 17:29:26 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.remotefs [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 is being set with open permissions: ugo+rw Sep 28 17:29:26 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 Sep 28 17:29:26 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" returned: 0 in 0.240s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" released by "_copy_volume_from_snapshot" :: held 6.600s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" released by "_create_volume_from_snapshot" :: held 6.664s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.679s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102d0551-7a8e-4edb-8c2d-3ce2cebdc11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7', 'volume_size': 1, 'snapshot_id': '3da2e669-59a4-4d58-b071-8c348cb2a161'}' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5c41f7-d113-48e4-b060-8811aa074517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:27 devstack cinder-volume[87034]: INFO cinder.volume.flows.manager.create_volume [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Volume volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 (c1e65d6b-516a-414b-af8e-d42e5beb0ca7): created successfully Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5c41f7-d113-48e4-b060-8811aa074517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87034) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:27 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Flow 'volume_create_manager' (0dd45c56-f522-4387-8bb2-518a9610d212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87034) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:27 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-179aa897-cb29-4cfa-bbac-e01ed7369138 tempest-SnapshotDependencyTests-1157597043 None] Created volume successfully. Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-3da2e669-59a4-4d58-b071-8c348cb2a161-delete_snapshot" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-3da2e669-59a4-4d58-b071-8c348cb2a161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" by "delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161" by "_delete_snapshot" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Deleting offline snapshot 3da2e669-59a4-4d58-b071-8c348cb2a161 of volume 0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] snapshot_file for this snap is: volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[47afe89e-a503-4c3b-86c5-823f3dd4d933]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:28 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.432s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0afd252f-8d9b-47e6-b591-847ded231239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87034) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[df40c14f-79d8-4a4c-828b-ba42e32dc01b]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:28 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:28 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.557s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:29 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.367s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161 Sep 28 17:29:29 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239.3da2e669-59a4-4d58-b071-8c348cb2a161" returned: 0 in 0.266s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-3da2e669-59a4-4d58-b071-8c348cb2a161" released by "_delete_snapshot" :: held 1.742s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" released by "delete_snapshot" :: held 1.763s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:29 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Created reservations ['2b5a966e-24b0-4f97-bf47-d1fc2d28484a', 'ac217811-59d4-41d5-af45-ed7ef0a9fb2c', '5d95d07d-755e-48a9-b22d-1dd491fdbb20', 'ed79d78d-31e9-4d62-b91b-74a40bff8df6'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:30 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Delete snapshot completed successfully. Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-56062f59-800c-4889-b9f3-0d3c3ac73fe2 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-3da2e669-59a4-4d58-b071-8c348cb2a161-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-0afd252f-8d9b-47e6-b591-847ded231239-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-0afd252f-8d9b-47e6-b591-847ded231239-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" acquired by "delete_volume" :: waited 0.015s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b654c-3bdd-4b80-832b-aaaab9df8da2]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:30 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.390s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239 Sep 28 17:29:30 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-0afd252f-8d9b-47e6-b591-847ded231239" returned: 0 in 0.272s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-0afd252f-8d9b-47e6-b591-847ded231239" released by "delete_volume" :: held 0.724s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Created reservations ['2699b823-b38c-4ade-87d6-d189bd546021', '996593ea-910b-4edd-87c2-8bdf84c4b8b3', 'eaec69c7-adbb-4b3b-b3ba-75487e5eb23f', 'eb9c2b26-a969-4c02-ae4a-e4271f5db5dc'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:29:31 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-c1e65d6b-516a-414b-af8e-d42e5beb0ca7-delete_volume" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.271s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:31 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Deleted volume successfully. Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-c1e65d6b-516a-414b-af8e-d42e5beb0ca7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-d4d9c0ab-d628-4aa7-a1e2-e9dd3494db26 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-0afd252f-8d9b-47e6-b591-847ded231239-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" by "delete_volume" {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" acquired by "delete_volume" :: waited 0.019s {{(pid=87034) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo.privsep.daemon [-] privsep: reply[674e0295-1f68-4102-810b-3f29cc134816]: (4, 'qcow2') {{(pid=88110) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 Sep 28 17:29:31 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" returned: 0 in 0.361s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7 Sep 28 17:29:32 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279/volume-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" returned: 0 in 0.281s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-quobyte-c1e65d6b-516a-414b-af8e-d42e5beb0ca7" released by "delete_volume" :: held 0.690s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.quota [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Created reservations ['fb6514cb-d43e-4d7e-af08-20111a83ae78', '9f82ce34-f318-4829-8d60-24c3c9b58885', 'd997422b-0dee-494b-888b-325492473613', '136973a1-8cac-4b4e-9e3f-92054e1e239a'] {{(pid=87034) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:29:32 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.250s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:32 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Deleted volume successfully. Sep 28 17:29:32 devstack cinder-volume[87034]: DEBUG cinder.coordination [None req-9588a4bd-c9d0-4ac4-a17b-126e8dd11955 tempest-SnapshotDependencyTests-1157597043 None] Lock "cinder-c1e65d6b-516a-414b-af8e-d42e5beb0ca7-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87034) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:42 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:42 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writing DB stats cinder:SELECT=20,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b807aa24-1021-44cd-adae-dbc284b26f2d'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:02 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279 Sep 28 17:30:02 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:02 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/97b4bc6cac09e1b8ad0d1c5a81389279" returned: 0 in 0.261s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread count: 28 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:30:02 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-e4862ae7-cd77-411e-a00f-8df13972db14 None None] thread info: [<_MainThread(MainThread, started 127156019208320)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}